-- Logs begin at Mon 2021-07-19 08:45:24 UTC, end at Mon 2021-07-19 10:08:14 UTC. -- Jul 19 09:17:06.491469 dv-cinder-793386-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 09:17:06.500477 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 09:17:06.502437 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 19 09:17:06 2021] *** Jul 19 09:17:06.502437 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 09:17:06.502437 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 09:17:06.502437 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: nodename: dv-cinder-793386-2-iscsi Jul 19 09:17:06.502437 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: machine: x86_64 Jul 19 09:17:06.502437 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: clock source: unix Jul 19 09:17:06.502437 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: pcre jit disabled Jul 19 09:17:06.502437 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: detected number of CPU cores: 4 Jul 19 09:17:06.502437 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: current working directory: / Jul 19 09:17:06.502437 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: detected binary path: /usr/bin/uwsgi-core Jul 19 09:17:06.503029 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: your processes number limit is 47680 Jul 19 09:17:06.503029 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: your memory page size is 4096 bytes Jul 19 09:17:06.503029 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: detected max file descriptor number: 2048 Jul 19 09:17:06.503029 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: lock engine: pthread robust mutexes Jul 19 09:17:06.503029 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: thunder lock: enabled Jul 19 09:17:06.503029 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 09:17:06.503029 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 19 09:17:06.547272 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: Python main interpreter initialized at 0x55c78e0879c0 Jul 19 09:17:06.547272 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: python threads support enabled Jul 19 09:17:06.547272 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: your server socket listen backlog is limited to 100 connections Jul 19 09:17:06.547272 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: your mercy for graceful operations on workers is 90 seconds Jul 19 09:17:06.547573 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 09:17:06.547660 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: *** Operational MODE: preforking *** Jul 19 09:17:06.547916 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: *** uWSGI is running in multiple interpreter mode *** Jul 19 09:17:06.547916 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: spawned uWSGI master process (pid: 92625) Jul 19 09:17:06.548087 dv-cinder-793386-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 19 09:17:06.549545 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: spawned uWSGI worker 1 (pid: 92626, cores: 1) Jul 19 09:17:06.549545 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: spawned uWSGI worker 2 (pid: 92627, cores: 1) Jul 19 09:17:06.549545 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 09:17:08.165574 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 09:17:08.165574 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: from cryptography.utils import int_from_bytes Jul 19 09:17:08.165574 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 09:17:08.165574 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: from cryptography.utils import int_from_bytes Jul 19 09:17:08.166901 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 09:17:08.166901 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: from cryptography.utils import int_from_bytes Jul 19 09:17:08.167504 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 09:17:08.167504 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: from cryptography.utils import int_from_bytes Jul 19 09:17:10.781078 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 09:17:10.781590 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 09:17:10.781771 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 09:17:10.782220 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 09:17:10.782334 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 09:17:10.782705 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 09:17:10.782791 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 09:17:10.782956 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.783096 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 09:17:10.783346 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 09:17:10.783450 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.783602 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 09:17:10.783836 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.783996 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.784264 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.784351 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.784637 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.784735 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.784956 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.785116 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.785283 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.785549 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.785636 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.785900 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.785992 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.786222 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.786401 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.786546 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.786750 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.786838 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.787132 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.787231 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.787458 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-793386-2-iscsi {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.787622 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-793386-2-iscsi {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.787780 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.788052 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.788152 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.788382 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.788477 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.788698 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.788876 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.789000 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.789305 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.789398 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.789612 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.789721 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.790107 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.790211 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.791270 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.791391 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.791464 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.791530 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.791613 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.791681 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.791758 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.791838 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.791913 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.791987 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.792080 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.792331 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.792438 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.792604 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.792707 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.792909 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.793006 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.793500 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.794130 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.794328 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.794483 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-793386-2-iscsi {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.794649 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.794788 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.794954 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.795127 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.795363 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-793386-2-iscsi {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.795456 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.795673 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.795842 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.795980 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.796152 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.796300 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.796467 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.796721 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.796822 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.797028 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.797127 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.797331 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.797418 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.797648 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.797745 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.797967 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.798057 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.798269 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.798363 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.798591 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.798678 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.798890 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.798983 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.799224 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.799314 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.799534 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.799628 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.799832 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.799919 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.800135 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.800223 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.800436 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.800556 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.800690 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.800797 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.800997 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.801096 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.801315 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.801496 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.801577 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.801651 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.801847 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.801940 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.802176 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.802279 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.802412 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.802563 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.802728 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.802819 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.803013 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.803120 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.803281 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.803372 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.803594 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.803681 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.803909 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.803999 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.804213 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.804307 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.804516 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.804617 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.804818 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.804906 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.805122 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.805209 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.805422 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.805516 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.805722 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.805810 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.806024 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.806118 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.806323 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.806438 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.806637 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.806742 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.806949 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.807057 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.807304 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.807407 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.807608 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.807695 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.807915 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.808002 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.808253 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.808343 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.808539 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.808626 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.808843 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.808967 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.809198 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.809294 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.809511 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.809605 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.809815 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.809901 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.810120 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.810209 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.810424 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.810511 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.810725 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.810866 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.811026 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.811164 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.811348 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.811436 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.811595 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.811683 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.811896 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.811984 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.812197 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.812292 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.812486 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.812586 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.812781 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.812875 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.813080 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.813167 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.813382 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.813477 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.813680 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.813774 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.813978 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.814064 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.814279 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.814379 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.814573 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.814661 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.814872 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.814960 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.815197 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.815319 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.815500 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.815595 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.815803 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.815889 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.816103 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.816198 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.816403 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.816496 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.816711 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.816816 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.817014 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.817110 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.817316 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.817405 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.817616 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.817707 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.817917 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.818011 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.818221 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.818314 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.818520 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.818613 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.818819 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.818911 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.819143 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.819250 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.819459 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.819550 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.819761 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.819862 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.820060 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.820160 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.820373 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.820463 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.820672 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.820771 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.820970 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.821063 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.821282 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.821374 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.821581 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.821672 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.821880 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.821978 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.822190 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.822287 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.822487 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.822577 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.822793 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.822886 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.823107 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.823221 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.823409 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.823498 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.823708 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.823796 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.824003 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.824104 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.824298 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.824385 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.824620 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.824706 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.824922 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.825020 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.825216 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.825303 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.825513 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.825599 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.825808 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.825908 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.826120 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.826208 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.826421 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.826508 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.826730 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.826884 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.827065 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.827166 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.827352 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.827440 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.827664 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:17:10.827837 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.827994 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.828082 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.828322 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.828417 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.828658 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.828747 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.828969 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.829056 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.829281 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.829374 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.829595 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.829683 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.829911 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.830004 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.830221 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.830307 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.830527 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.830621 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.830835 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.830921 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.831168 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.831280 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.831476 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.831563 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.831783 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.831870 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.832096 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.832191 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.832410 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.832506 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.832727 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.832822 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.833036 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.833129 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.833350 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.833440 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.833664 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.833754 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.833970 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.834067 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.834280 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.834366 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.834600 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.834687 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.834917 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.835013 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.835248 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.835338 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.835585 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.835681 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.835892 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.835988 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.836214 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.836320 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.836529 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.836618 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.836821 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.836921 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.837132 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.837220 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.837438 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.837568 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.837746 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.837835 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.838053 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.838167 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.838363 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.838540 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.838670 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.838894 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.838981 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.839312 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.839412 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.839623 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.839720 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.839935 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.840023 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.840749 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.840844 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.841051 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.841189 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.841351 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.841534 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.841654 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.841890 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.841986 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.842256 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.842345 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.842576 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.842662 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.842879 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.842975 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.843227 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.843316 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.843530 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.843648 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.843837 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.843997 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.844142 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.844340 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.844437 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.844694 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.844780 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.845031 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.845125 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.845333 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.845420 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.845650 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.845744 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.845955 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.846049 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.846255 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.846381 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.846571 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.846752 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.846878 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.847082 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.847193 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.847394 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.847501 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.847710 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.847794 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.848022 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.848117 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.848333 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.848420 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.848644 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.848739 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.848961 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.849048 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.849265 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.849360 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.849574 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.849668 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.849907 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.849992 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.850209 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.850308 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.850528 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.850616 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.850847 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.850937 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.851180 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.851356 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.851483 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.851571 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.851788 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.851875 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.852085 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.852180 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.852383 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.852479 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.852683 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.852771 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.852983 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.853078 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.853280 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.853406 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.853579 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.853669 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.853877 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.853977 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.854174 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.854262 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.854472 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.854560 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.854775 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.854872 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.855098 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.855209 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.855400 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.855499 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.855698 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.855796 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.856559 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.856661 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.856868 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.856963 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.857196 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.857293 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.857503 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.857605 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.857817 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.857918 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.858135 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.858233 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.858446 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.858543 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.858752 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.858848 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.859058 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.859157 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.859364 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.859468 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.859665 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.859769 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.859975 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.860072 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.860271 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.860366 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.860576 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.860681 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.860876 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.860972 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.861177 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.861280 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.861485 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.861591 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.861806 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.861902 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.862107 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.862202 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.862413 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.862518 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.862726 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.862821 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.863030 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.863161 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.863368 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.863481 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.863666 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.863766 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.863967 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.864063 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.864267 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.864364 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.864568 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.864662 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.864870 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.864972 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.865175 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.865271 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.865565 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.865668 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.865798 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.865909 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.866080 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.866175 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.866383 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.866478 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.866689 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.866783 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.866985 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.867104 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.867312 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.867400 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.867625 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.867726 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.867925 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.868024 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.868241 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.868330 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.868556 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.868652 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.868855 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.868949 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.869157 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.869254 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.869460 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.869566 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.869767 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.869863 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.870068 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.870156 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.870369 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.870465 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.870668 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.870754 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.870967 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.871073 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.871323 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.871423 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.871661 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.871749 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.871967 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.872056 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.872279 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.872368 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.872589 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.872685 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.872898 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.872985 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.873202 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.873290 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.873506 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.873595 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.873814 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.873926 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.874117 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.874212 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.874421 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.874509 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.874725 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.874823 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.875054 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.875142 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.875359 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.875450 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.875665 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.875765 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.875975 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.876064 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.876275 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.876362 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.876579 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.876676 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.876884 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.876981 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.877182 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.877269 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.877483 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.877592 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.877790 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.877926 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.878109 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.878350 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.878670 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.878774 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.878976 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.879100 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.879313 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.879409 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.879626 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.879728 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.879938 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.880027 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.880251 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.880345 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.880571 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.880667 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.880878 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.880967 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.881180 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.881277 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.881485 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.881572 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.881782 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.881875 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.882081 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.882171 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.882384 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.882479 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.882681 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.882768 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.882980 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.883101 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.883304 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.883401 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.883607 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.883694 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.883907 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.884036 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.884206 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.884294 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.884504 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.884590 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.884806 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.884903 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.885109 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.885197 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.885405 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.885491 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.885710 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.885806 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.886009 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.886095 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.886308 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.886394 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.886616 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.886712 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.886919 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.887015 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.887266 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.887394 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.887567 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.887708 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.887869 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.887996 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.888202 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.888337 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.888497 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.888626 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.888831 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.888962 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.889160 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.889288 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.889461 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.889589 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.889763 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.889891 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.890076 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.890204 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.890376 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.890503 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.890677 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.890805 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.890976 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.891143 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.891306 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.891439 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.891607 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.891743 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.891907 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.892045 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.892206 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.892333 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.892515 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.892653 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.892820 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.892950 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.893125 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.893267 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.893466 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.893599 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.893731 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.893855 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.894058 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.894186 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.894323 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.894457 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.894584 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.894708 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.894887 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.895017 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.895208 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.895340 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.895508 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.895635 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.895807 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.895947 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.896106 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.896235 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.896404 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.896537 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.896706 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.896847 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.897003 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.897132 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.897300 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.897429 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.897599 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.897737 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.897897 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.898024 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.898197 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.898405 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.898535 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.898670 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.898796 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.898920 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.899108 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.899247 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.899401 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.899540 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.899701 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.899830 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.900000 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.900127 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.900296 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.900426 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.900595 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.900729 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.900896 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.901025 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.901203 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.901334 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.901511 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.901639 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.901811 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.901942 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.902112 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.902241 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.902408 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.902535 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.903253 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.903386 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.903558 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.903691 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.903861 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.903990 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.904194 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.904398 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.904534 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.904660 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.904793 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.904919 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.905044 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.905179 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.905313 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.905439 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.905599 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.905729 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.905900 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.906042 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.906198 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.906327 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.906498 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.906627 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.906800 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.906944 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.907180 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.907307 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.907439 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.907564 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.907783 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.907922 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.908085 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.908212 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.908463 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.908608 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.908744 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.908871 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.909003 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.909129 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.909292 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.909429 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.909602 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.909732 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.909904 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.910034 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.910213 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.910343 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.910518 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.910649 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.910826 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.910954 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.911145 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.911286 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.911445 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.911575 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.911746 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.911874 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.912053 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.912181 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.912357 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.912486 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.912662 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.912793 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.912975 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.913112 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.913290 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.913419 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.913590 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.913718 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.913892 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.914029 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.914237 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.914374 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.914499 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.914632 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.914765 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.914901 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.915094 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.915227 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.915400 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.915531 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.915706 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.915848 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.916010 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.916139 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.916314 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.916442 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.916621 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.916759 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.916921 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.917051 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.917224 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.917359 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.917524 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.917652 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.917823 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.917951 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.918123 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.918571 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.919275 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.919406 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.919538 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.919671 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.919839 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.919969 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.920141 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.920271 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.920442 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.920569 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.920742 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.920877 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.921044 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.921173 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.921458 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.921586 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.921766 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.921904 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.922066 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.922188 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.922367 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.922495 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.922670 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.922806 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.922976 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.923147 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.923312 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.923451 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.923615 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.923757 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.923918 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.924053 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.924344 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.924480 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.924627 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.924766 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.924935 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.925065 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.925238 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.925366 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.925540 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.925678 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.925842 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.925970 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.926152 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.926282 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.926449 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.926578 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.926756 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.926885 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.927074 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.927207 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.927382 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.927511 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.927690 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.927820 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.928147 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.928286 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.928422 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.928549 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.928704 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.928832 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.929004 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.929139 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.929292 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.929482 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.929708 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.929839 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.930014 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.930151 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.930320 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.930455 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.930639 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.930766 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.930958 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.931118 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.931286 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.931415 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.931597 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.931725 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.931905 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.932049 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.932212 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.932340 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.932531 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.932658 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.932838 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.932976 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.933147 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.933277 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.933450 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.933581 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.933783 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.933932 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.934102 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.934237 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.934427 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.934570 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.934711 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.934843 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.935084 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.935216 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.935458 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.935585 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.935766 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.935896 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.936083 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.936221 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.936404 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.936636 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.936775 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.936902 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.937034 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.937160 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.937286 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.937419 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.937586 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.937716 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.937887 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.938018 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.938196 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.938325 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.938498 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.938605 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.938804 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.938909 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.939135 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.939247 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.939439 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.939524 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.939741 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.939837 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.940040 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.940137 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.940342 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.940430 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.940647 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.940733 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.940950 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.941045 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.941263 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.941357 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.941574 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.941661 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.941889 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.941977 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.942189 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.942295 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.942504 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.942606 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.942806 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.942901 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.943132 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.943235 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.943435 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.943531 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.943737 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.943834 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.944044 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.944141 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.944362 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.944449 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.944680 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.944768 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.944996 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.945084 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.945319 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.945412 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.945628 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.945723 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.945941 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.946029 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.946262 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.946372 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.946576 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.946666 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.946889 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.946984 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.947231 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.947319 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.947533 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.947638 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.947834 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.947923 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.948137 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.948236 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.948435 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.948540 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.948736 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.948825 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.949036 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.949130 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.949336 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.949432 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.949660 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.949757 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.949960 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.950048 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.950258 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.950375 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.950561 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.950649 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.950860 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.950947 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.951197 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.951301 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.951501 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.951587 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.951800 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.951889 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.952099 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.952188 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.952398 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.952486 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.952701 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.952796 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.953024 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.953119 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.953330 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.953418 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.953649 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.953736 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.953964 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.954053 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.954286 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.954394 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.954593 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.954681 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.954911 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.955000 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.955245 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.955351 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.955558 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.955655 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.955871 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.955959 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.956177 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.956264 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.956489 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.956587 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.956805 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.956900 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.957114 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.957201 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.957419 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.957519 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.957724 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.957811 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.958032 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.958119 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.958346 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.958453 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.958658 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.958855 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.959203 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.959296 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.959514 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.959603 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.959825 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.959912 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.960132 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.960220 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.960441 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.960537 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.960745 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.960833 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.961053 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.961140 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.961359 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.961449 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.961665 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.961753 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.961967 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.962060 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.962272 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.962361 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.962596 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.962686 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.962922 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.963018 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.963277 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.963368 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.963591 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.963679 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.963902 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.964000 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.964211 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.964300 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.964528 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.964616 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.964847 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.964938 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.965694 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.965825 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.966002 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.966121 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.966317 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.966433 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.966634 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.966730 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.966946 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.967208 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.967333 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.967438 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.967592 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.967909 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.968023 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.969245 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.969351 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.969435 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.969523 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.969606 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.969687 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.969780 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.969871 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.969942 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.970021 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.970101 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.970191 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.970273 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.970353 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.970433 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.970596 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.970685 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.970914 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.971003 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.971249 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.971338 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.971560 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.971659 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.971873 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.972114 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.972388 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.972476 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.972700 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.972788 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.973029 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.973118 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.973352 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.973447 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.973672 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.973834 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.973985 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.974073 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.974302 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.974397 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.974614 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.974711 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.974916 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.975003 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.975246 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.975335 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.975551 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.975656 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.975857 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.975951 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.976160 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.976249 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.976468 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.976564 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.976773 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.976860 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.977072 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.977166 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.977387 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.977475 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.977691 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.977915 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.978217 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.978307 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.978558 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.978654 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.978874 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.978969 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.979221 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.979325 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.979542 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.979650 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.979849 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.979938 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.980152 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.980250 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.980467 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.980555 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.980767 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.980884 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.981617 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.981707 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.981929 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.982018 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.982236 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.982335 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.982536 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.982633 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.982839 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.982927 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.983170 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.983262 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.983477 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.983577 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.983780 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.983875 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.984100 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.984196 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.984383 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.984482 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.984707 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.984794 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.985008 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.985096 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.985310 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.985405 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.985614 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.985702 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.985915 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.986002 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.986215 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.986302 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.986517 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.986604 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.986821 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.986909 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.987142 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.987232 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.987447 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.987535 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.987756 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.987915 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.988061 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.988224 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.988371 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.988528 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.988674 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.988838 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.988982 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.989141 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.989284 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.989447 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.989671 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.989765 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.989895 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.990056 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.990190 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.990357 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.990498 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.990659 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.990807 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.990972 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.991162 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.991302 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.991475 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.991621 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.991783 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.991931 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.992237 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.992323 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.992577 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.992678 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.992890 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.993124 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.993419 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.993506 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.993754 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.993852 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.994077 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.994165 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.994416 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.994550 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.994752 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.994843 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.995081 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.995183 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.995393 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.995482 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.995699 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.995788 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.996013 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.996101 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.996321 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.996440 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.996658 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.996747 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.996966 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.997062 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.997273 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.997362 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.997581 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.997677 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.997886 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.997973 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.998192 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.998288 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.998497 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.998584 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.998803 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.998890 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.999157 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.999264 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.999493 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.999588 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.999809 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:10.999915 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.000119 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.000257 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.000429 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.000516 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.000739 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.000826 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.001044 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.001144 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.001352 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.001438 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.001656 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.001741 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.001979 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.002074 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.002287 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.002375 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.002606 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.002693 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.002911 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.003098 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.003235 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.003358 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.003650 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.003737 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.003958 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.004055 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.004273 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.004361 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.004585 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.004680 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.004890 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.004977 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.005216 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.005304 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.005549 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.005646 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.005869 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.005956 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.006174 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.006269 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.006479 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.006576 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.006782 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.006871 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.007101 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.007229 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.007411 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.007543 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.007748 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.007843 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.008070 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.008157 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.008381 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.008468 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.008692 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.008779 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.008997 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.009083 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.009304 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.009398 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.009606 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.009692 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.009915 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.010015 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.010217 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.010307 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.010523 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.010618 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.010830 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.010917 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.011161 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.011250 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.011477 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.011565 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.011784 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.011872 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.012617 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.012712 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.012928 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.013015 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.013235 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.013334 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.013534 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.013621 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.013845 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.013933 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.014149 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.014253 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.014460 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.014549 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.014786 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.014874 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.015118 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.015222 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.015432 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.015519 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.015736 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.015830 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.016048 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.016143 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.016351 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.016437 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.016672 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.016768 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.016983 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.017078 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.017291 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.017379 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.017594 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.017682 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.017915 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.018004 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.018219 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.018313 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.018525 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.018650 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.018831 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.018931 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.019158 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.019259 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.019464 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.019553 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.019769 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.019931 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.020094 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.020185 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.020396 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.020536 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.020706 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.020793 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.021020 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.021108 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.021328 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.021424 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.021640 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.021728 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.021950 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.022038 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.022265 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.022360 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.022573 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.022660 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.022886 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.022973 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.023219 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.023310 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.023525 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.023612 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.023832 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.023918 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.024144 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.024232 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.024455 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.024548 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.024779 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.024874 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.025100 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.025187 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.025420 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.025513 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.025742 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.025830 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.026055 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.026142 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.026381 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.026469 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.026704 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.026799 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.026945 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 09:17:11.027052 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:17:11.027283 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 09:17:11.050105 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_db.sqlalchemy.engines [None req-6d2b6147-c9d7-43c5-b6cb-8dc8089029da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:17:11.050942 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG oslo_db.sqlalchemy.engines [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:17:11.126310 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.context [None req-6d2b6147-c9d7-43c5-b6cb-8dc8089029da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15c05796-47fc-4258-ab4c-71158a7062ab(cell1) {{(pid=92627) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 09:17:11.127652 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.context [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15c05796-47fc-4258-ab4c-71158a7062ab(cell1) {{(pid=92626) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 09:17:11.130484 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_concurrency.lockutils [None req-6d2b6147-c9d7-43c5-b6cb-8dc8089029da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:17:11.131834 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG oslo_concurrency.lockutils [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:17:11.132122 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_concurrency.lockutils [None req-6d2b6147-c9d7-43c5-b6cb-8dc8089029da None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:17:11.132915 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_concurrency.lockutils [None req-6d2b6147-c9d7-43c5-b6cb-8dc8089029da None None] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:17:11.133462 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG oslo_concurrency.lockutils [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:17:11.134270 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG oslo_concurrency.lockutils [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:17:11.134816 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_concurrency.lockutils [None req-6d2b6147-c9d7-43c5-b6cb-8dc8089029da None None] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:17:11.136250 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG oslo_concurrency.lockutils [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:17:11.145590 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_db.sqlalchemy.engines [None req-6d2b6147-c9d7-43c5-b6cb-8dc8089029da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:17:11.148324 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG oslo_db.sqlalchemy.engines [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:17:11.151133 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG oslo_db.sqlalchemy.engines [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:17:11.153793 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_db.sqlalchemy.engines [None req-6d2b6147-c9d7-43c5-b6cb-8dc8089029da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:17:11.501368 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_db.sqlalchemy.engines [None req-6d2b6147-c9d7-43c5-b6cb-8dc8089029da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:17:11.503884 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG oslo_db.sqlalchemy.engines [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:17:11.839681 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: WARNING keystonemiddleware.auth_token [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 09:17:11.842221 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: WARNING keystonemiddleware.auth_token [None req-6d2b6147-c9d7-43c5-b6cb-8dc8089029da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 09:17:11.846430 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: WARNING keystonemiddleware.auth_token [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 09:17:11.849530 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: WARNING keystonemiddleware.auth_token [None req-6d2b6147-c9d7-43c5-b6cb-8dc8089029da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 09:17:12.188838 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: WARNING keystonemiddleware.auth_token [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 09:17:12.194069 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: WARNING keystonemiddleware.auth_token [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 09:17:12.196649 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: WARNING keystonemiddleware.auth_token [None req-6d2b6147-c9d7-43c5-b6cb-8dc8089029da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 09:17:12.199187 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c78e0879c0 pid: 92626 (default app) Jul 19 09:17:12.201305 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:17:12.201986 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: WARNING keystonemiddleware.auth_token [None req-6d2b6147-c9d7-43c5-b6cb-8dc8089029da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 09:17:12.202487 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001766 Jul 19 09:17:12.202880 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 789 bytes} [Mon Jul 19 09:17:12 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:17:12.207394 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c78e0879c0 pid: 92627 (default app) Jul 19 09:18:30.688346 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:18:30.689485 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Jul 19 09:18:30.689986 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Mon Jul 19 09:18:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:18:31.119954 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-7383a7f4-20ed-4712-9ecc-711c66b377f0 admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:18:31.149349 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-7383a7f4-20ed-4712-9ecc-711c66b377f0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.452089 Jul 19 09:18:31.150258 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Jul 19 09:18:30 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:18:33.349479 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:18:33.350483 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-3410ec95-68a7-4ec8-bfcc-ee6f55ff736a None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Jul 19 09:18:33.350891 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Mon Jul 19 09:18:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:18:33.412543 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-112a57fc-d587-479c-afed-f26f55b663e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1", "swap": 0}} {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:33.432272 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:18:33.432272 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: warnings.warn(msg) Jul 19 09:18:33.465183 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-112a57fc-d587-479c-afed-f26f55b663e9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107693 Jul 19 09:18:33.466211 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Jul 19 09:18:33 2021] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:18:33.693835 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-5b4cd6d2-f6bd-4e2a-a883-cb527923691e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:33.696377 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:18:33.696377 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: warnings.warn(msg) Jul 19 09:18:33.743961 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-5b4cd6d2-f6bd-4e2a-a883-cb527923691e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.270139 Jul 19 09:18:33.744733 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Jul 19 09:18:33 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:18:35.927324 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-112a57fc-d587-479c-afed-f26f55b663e9 admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:18:35.928365 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-112a57fc-d587-479c-afed-f26f55b663e9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 19 09:18:35.929328 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Mon Jul 19 09:18:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:18:36.043371 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-8760c4ed-80c0-4e45-9f47-66dc3244846c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "vcpus": 1}} {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:36.062309 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:18:36.062309 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: warnings.warn(msg) Jul 19 09:18:36.080961 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-8760c4ed-80c0-4e45-9f47-66dc3244846c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145664 Jul 19 09:18:36.081520 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Jul 19 09:18:35 2021] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:18:36.094648 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-7abe38ab-cdf5-41d1-89e2-82b72444f5c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:36.096154 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:18:36.096154 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: warnings.warn(msg) Jul 19 09:18:36.136181 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-7abe38ab-cdf5-41d1-89e2-82b72444f5c5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046474 Jul 19 09:18:36.136915 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Jul 19 09:18:36 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:18:38.310321 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-8760c4ed-80c0-4e45-9f47-66dc3244846c admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:18:38.311375 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-8760c4ed-80c0-4e45-9f47-66dc3244846c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 19 09:18:38.311954 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Mon Jul 19 09:18:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:18:38.368211 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-f9abb332-1e29-44e9-87f0-277c51c2c77f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:38.386806 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-f9abb332-1e29-44e9-87f0-277c51c2c77f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069124 Jul 19 09:18:38.387512 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Jul 19 09:18:38 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:18:38.399924 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-19a47ff9-c31f-4250-839d-bd78cd9d61cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:38.427908 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-19a47ff9-c31f-4250-839d-bd78cd9d61cc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032510 Jul 19 09:18:38.428755 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Jul 19 09:18:38 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:18:40.608319 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-f9abb332-1e29-44e9-87f0-277c51c2c77f admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:18:40.611397 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-f9abb332-1e29-44e9-87f0-277c51c2c77f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002877 Jul 19 09:18:40.611397 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Mon Jul 19 09:18:40 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:18:40.690243 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-ee4f37db-bbd8-43a0-94e6-fcdf1d744c4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:40.711766 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-ee4f37db-bbd8-43a0-94e6-fcdf1d744c4d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.094233 Jul 19 09:18:40.713312 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Jul 19 09:18:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:18:40.724568 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-24e72cff-dfc1-4bf6-aac6-3b6ec7ea0ce2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:40.751520 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-24e72cff-dfc1-4bf6-aac6-3b6ec7ea0ce2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030988 Jul 19 09:18:40.752108 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Jul 19 09:18:40 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:18:42.938994 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-ee4f37db-bbd8-43a0-94e6-fcdf1d744c4d admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:18:42.940062 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-ee4f37db-bbd8-43a0-94e6-fcdf1d744c4d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 19 09:18:42.940628 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Mon Jul 19 09:18:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:18:42.997606 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-b9c30cc9-ce47-4df4-993c-3add1dfa154b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d4", "disk": 20, "vcpus": 4, "swap": 0, "ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:43.016826 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-b9c30cc9-ce47-4df4-993c-3add1dfa154b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070118 Jul 19 09:18:43.018070 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Jul 19 09:18:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:18:43.028918 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-f63fe53f-b54d-412b-886c-2df7ebe38876 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:43.051797 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-f63fe53f-b54d-412b-886c-2df7ebe38876 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026445 Jul 19 09:18:43.052349 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Jul 19 09:18:43 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:18:45.221684 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-b9c30cc9-ce47-4df4-993c-3add1dfa154b admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:18:45.222689 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-b9c30cc9-ce47-4df4-993c-3add1dfa154b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 19 09:18:45.223259 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Mon Jul 19 09:18:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:18:45.281104 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-2a0c6873-c7e5-4e13-8d0f-e50056f62a49 admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:18:45.307513 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-2a0c6873-c7e5-4e13-8d0f-e50056f62a49 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077813 Jul 19 09:18:45.309830 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Jul 19 09:18:45 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:18:47.454430 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-b9c30cc9-ce47-4df4-993c-3add1dfa154b admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:18:47.455490 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-b9c30cc9-ce47-4df4-993c-3add1dfa154b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 19 09:18:47.455894 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Mon Jul 19 09:18:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:18:47.513084 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-e399eacd-41ee-43b6-991f-cf1d8b7e0b73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "name": "m1.tiny", "vcpus": 1, "ram": 512, "id": "1", "swap": 0}} {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:47.534653 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-e399eacd-41ee-43b6-991f-cf1d8b7e0b73 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072563 Jul 19 09:18:47.535529 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Jul 19 09:18:47 2021] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:18:47.547650 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-86869ecb-487c-43b4-bd53-a89cd4585476 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:47.570242 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-86869ecb-487c-43b4-bd53-a89cd4585476 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025671 Jul 19 09:18:47.571024 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Jul 19 09:18:47 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:18:50.293602 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-e399eacd-41ee-43b6-991f-cf1d8b7e0b73 admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:18:50.294612 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-e399eacd-41ee-43b6-991f-cf1d8b7e0b73 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 19 09:18:50.295016 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Mon Jul 19 09:18:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:18:50.350683 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-2192ebc0-8984-428d-ab5b-6eda9cfab0ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "ram": 2048, "swap": 0, "id": "2", "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:50.369369 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-2192ebc0-8984-428d-ab5b-6eda9cfab0ba admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068478 Jul 19 09:18:50.369933 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Jul 19 09:18:50 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:18:50.381247 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-86035712-112b-4e1a-b685-e9290553b315 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:50.403950 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-86035712-112b-4e1a-b685-e9290553b315 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026248 Jul 19 09:18:50.404528 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Jul 19 09:18:50 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:18:52.567322 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-2192ebc0-8984-428d-ab5b-6eda9cfab0ba admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:18:52.568348 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-2192ebc0-8984-428d-ab5b-6eda9cfab0ba admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 19 09:18:52.568757 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Mon Jul 19 09:18:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:18:52.623128 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-c566ef51-aaee-427d-8c2b-30c0c9da19fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "swap": 0, "name": "m1.medium"}} {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:52.641395 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-c566ef51-aaee-427d-8c2b-30c0c9da19fd admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.066772 Jul 19 09:18:52.641949 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Jul 19 09:18:52 2021] POST /compute/v2.1/flavors => generated 406 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:18:52.653474 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-fd79fd68-e92e-4eac-90e7-bd3db8450c98 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:52.675558 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-fd79fd68-e92e-4eac-90e7-bd3db8450c98 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025788 Jul 19 09:18:52.676295 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Jul 19 09:18:52 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:18:54.818937 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-c566ef51-aaee-427d-8c2b-30c0c9da19fd admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:18:54.820522 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-c566ef51-aaee-427d-8c2b-30c0c9da19fd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Jul 19 09:18:54.821060 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Mon Jul 19 09:18:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:18:54.874709 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-5ea9c157-d38d-47e2-9397-7b9732c126ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "id": "4", "vcpus": 4, "name": "m1.large", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:54.892712 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-5ea9c157-d38d-47e2-9397-7b9732c126ac admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.065777 Jul 19 09:18:54.893431 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Jul 19 09:18:54 2021] POST /compute/v2.1/flavors => generated 405 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:18:54.905479 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-bee8500b-4ede-4aa3-9409-4222495b3508 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:54.927471 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-bee8500b-4ede-4aa3-9409-4222495b3508 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025616 Jul 19 09:18:54.928100 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Jul 19 09:18:54 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:18:57.101902 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-5ea9c157-d38d-47e2-9397-7b9732c126ac admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:18:57.103577 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-5ea9c157-d38d-47e2-9397-7b9732c126ac admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002096 Jul 19 09:18:57.103971 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Mon Jul 19 09:18:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:18:57.168824 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-b0958371-380e-47f6-b2dc-c8712ef60096 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "name": "m1.xlarge", "swap": 0, "vcpus": 8}} {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:57.187825 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-b0958371-380e-47f6-b2dc-c8712ef60096 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078089 Jul 19 09:18:57.188472 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Jul 19 09:18:57 2021] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:18:57.200400 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-24187ccc-f941-4e0e-93f2-712fef584fe0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:18:57.226648 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-24187ccc-f941-4e0e-93f2-712fef584fe0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030161 Jul 19 09:18:57.227246 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Jul 19 09:18:57 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:19:37.598581 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-b0958371-380e-47f6-b2dc-c8712ef60096 admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:37.599624 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-b0958371-380e-47f6-b2dc-c8712ef60096 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 19 09:19:37.600019 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Mon Jul 19 09:19:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:19:37.654413 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-869e1f35-8e03-4bdc-88aa-7214e9f9f36f admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:37.671708 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-869e1f35-8e03-4bdc-88aa-7214e9f9f36f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.065959 Jul 19 09:19:37.672244 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Jul 19 09:19:37 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:19:39.064426 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-b0958371-380e-47f6-b2dc-c8712ef60096 admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:39.065429 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-b0958371-380e-47f6-b2dc-c8712ef60096 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jul 19 09:19:39.065852 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1075 bytes} [Mon Jul 19 09:19:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:19:39.265144 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-c517b31a-1335-468a-879f-f8df48c79f49 admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:39.270636 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.wsgi [None req-c517b31a-1335-468a-879f-f8df48c79f49 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 09:19:39.271240 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-c517b31a-1335-468a-879f-f8df48c79f49 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:19:39.272048 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-c517b31a-1335-468a-879f-f8df48c79f49 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.065940 Jul 19 09:19:39.272571 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Jul 19 09:19:39 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 09:19:39.282068 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-63273269-7983-4bfd-a866-ce70639c7bb7 admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:39.303634 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-63273269-7983-4bfd-a866-ce70639c7bb7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025156 Jul 19 09:19:39.304150 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1211 bytes} [Mon Jul 19 09:19:39 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:19:39.313706 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-dee713aa-9302-4030-8f36-d63a20a72be5 admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:39.334299 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-dee713aa-9302-4030-8f36-d63a20a72be5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024081 Jul 19 09:19:39.334829 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1211 bytes} [Mon Jul 19 09:19:39 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:19:39.344122 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-e9d86911-dde1-4675-b33b-35c76ad63b30 admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:39.349936 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.wsgi [None req-e9d86911-dde1-4675-b33b-35c76ad63b30 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 09:19:39.350489 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-e9d86911-dde1-4675-b33b-35c76ad63b30 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:19:39.351301 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-e9d86911-dde1-4675-b33b-35c76ad63b30 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010793 Jul 19 09:19:39.351788 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Jul 19 09:19:39 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 09:19:40.677719 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-dee713aa-9302-4030-8f36-d63a20a72be5 admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:40.678722 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-dee713aa-9302-4030-8f36-d63a20a72be5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jul 19 09:19:40.679143 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1075 bytes} [Mon Jul 19 09:19:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:19:40.869073 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-44227d82-e333-4405-9ba9-cbca8ca47d59 admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:40.874185 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.wsgi [None req-44227d82-e333-4405-9ba9-cbca8ca47d59 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 09:19:40.874735 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-44227d82-e333-4405-9ba9-cbca8ca47d59 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:19:40.875566 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-44227d82-e333-4405-9ba9-cbca8ca47d59 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.055051 Jul 19 09:19:40.876066 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Jul 19 09:19:40 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 19 09:19:40.885665 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-977dce4b-1603-426b-ba3e-ff63c3f51109 admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:40.899490 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-977dce4b-1603-426b-ba3e-ff63c3f51109 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017246 Jul 19 09:19:40.899949 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1211 bytes} [Mon Jul 19 09:19:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:19:40.908898 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-c02028f1-e3dd-4751-9725-b02833bc9ca3 admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:40.922396 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-c02028f1-e3dd-4751-9725-b02833bc9ca3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016922 Jul 19 09:19:40.922911 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1211 bytes} [Mon Jul 19 09:19:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:19:40.931890 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-7119967c-9535-463b-9fee-9390f99840fa admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:40.936864 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.wsgi [None req-7119967c-9535-463b-9fee-9390f99840fa admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 09:19:40.937418 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-7119967c-9535-463b-9fee-9390f99840fa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:19:40.938201 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-7119967c-9535-463b-9fee-9390f99840fa admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.009734 Jul 19 09:19:40.938678 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Jul 19 09:19:40 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 09:19:42.244357 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-c02028f1-e3dd-4751-9725-b02833bc9ca3 admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:42.245340 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-c02028f1-e3dd-4751-9725-b02833bc9ca3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001383 Jul 19 09:19:42.245725 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1075 bytes} [Mon Jul 19 09:19:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:19:42.429879 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-d0840440-9fcc-4672-bc94-b0e515c5777b admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:42.434960 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.wsgi [None req-d0840440-9fcc-4672-bc94-b0e515c5777b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 09:19:42.435548 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-d0840440-9fcc-4672-bc94-b0e515c5777b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:19:42.436321 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-d0840440-9fcc-4672-bc94-b0e515c5777b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.054002 Jul 19 09:19:42.436810 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Jul 19 09:19:42 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 19 09:19:42.446344 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-27cb62d1-e78a-4610-a39a-364a8a0a9ed1 admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:42.459947 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-27cb62d1-e78a-4610-a39a-364a8a0a9ed1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017090 Jul 19 09:19:42.460447 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1211 bytes} [Mon Jul 19 09:19:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:19:42.469742 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-9fbd7d78-f91e-46f2-8cb1-91ac28a138b9 admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:42.482390 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-9fbd7d78-f91e-46f2-8cb1-91ac28a138b9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016390 Jul 19 09:19:42.482892 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1211 bytes} [Mon Jul 19 09:19:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:19:42.491438 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-06e1aeec-ac8a-4fe4-9af1-5f0b2a2660df admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:42.496322 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.wsgi [None req-06e1aeec-ac8a-4fe4-9af1-5f0b2a2660df admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 09:19:42.496862 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-06e1aeec-ac8a-4fe4-9af1-5f0b2a2660df admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:19:42.497629 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-06e1aeec-ac8a-4fe4-9af1-5f0b2a2660df admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.009537 Jul 19 09:19:42.498100 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Jul 19 09:19:42 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 09:19:43.818053 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-9fbd7d78-f91e-46f2-8cb1-91ac28a138b9 admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:43.819070 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-9fbd7d78-f91e-46f2-8cb1-91ac28a138b9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jul 19 09:19:43.819467 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1075 bytes} [Mon Jul 19 09:19:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:19:44.005293 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-a5b4d375-e43b-458b-ae4d-63609622da6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:19:44.023027 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-a5b4d375-e43b-458b-ae4d-63609622da6e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.066431 Jul 19 09:19:44.023615 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1236 bytes} [Mon Jul 19 09:19:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:19:45.353126 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-9fbd7d78-f91e-46f2-8cb1-91ac28a138b9 admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:45.354137 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-9fbd7d78-f91e-46f2-8cb1-91ac28a138b9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 19 09:19:45.354552 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1075 bytes} [Mon Jul 19 09:19:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:19:45.540372 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-17bf24a5-d2c3-4264-90b2-3f2d8ed63127 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:19:45.557965 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-17bf24a5-d2c3-4264-90b2-3f2d8ed63127 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.065172 Jul 19 09:19:45.558509 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1236 bytes} [Mon Jul 19 09:19:45 2021] POST /compute/v2.1/flavors => generated 405 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:19:46.884010 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-9fbd7d78-f91e-46f2-8cb1-91ac28a138b9 admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:46.885006 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-9fbd7d78-f91e-46f2-8cb1-91ac28a138b9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jul 19 09:19:46.885403 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1075 bytes} [Mon Jul 19 09:19:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:19:47.071977 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-831c111e-8ab8-4f03-987d-4a4a04928945 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:19:47.089649 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-831c111e-8ab8-4f03-987d-4a4a04928945 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.066071 Jul 19 09:19:47.090188 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1236 bytes} [Mon Jul 19 09:19:47 2021] POST /compute/v2.1/flavors => generated 407 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:19:48.415548 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-9fbd7d78-f91e-46f2-8cb1-91ac28a138b9 admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:48.416855 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-9fbd7d78-f91e-46f2-8cb1-91ac28a138b9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 19 09:19:48.417196 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1075 bytes} [Mon Jul 19 09:19:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:19:48.602990 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-b7c81e1c-4c2f-4807-a3ca-0c03ead8f3e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:19:48.621256 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-b7c81e1c-4c2f-4807-a3ca-0c03ead8f3e3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.066342 Jul 19 09:19:48.621796 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1236 bytes} [Mon Jul 19 09:19:48 2021] POST /compute/v2.1/flavors => generated 409 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:19:49.941742 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-9fbd7d78-f91e-46f2-8cb1-91ac28a138b9 admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:49.942731 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-9fbd7d78-f91e-46f2-8cb1-91ac28a138b9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 19 09:19:49.943146 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1075 bytes} [Mon Jul 19 09:19:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:19:50.126910 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-399d565b-1918-4bb0-955f-6c99aecb970d admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:19:50.146732 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-399d565b-1918-4bb0-955f-6c99aecb970d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.066672 Jul 19 09:19:50.147280 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1203 bytes} [Mon Jul 19 09:19:50 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:20:34.403414 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-9fbd7d78-f91e-46f2-8cb1-91ac28a138b9 admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:20:34.404402 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-9fbd7d78-f91e-46f2-8cb1-91ac28a138b9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 19 09:20:34.404795 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Mon Jul 19 09:20:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:20:34.458172 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-e67c1889-2c13-4452-844d-c04ecc556bb9 admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:20:34.476588 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-e67c1889-2c13-4452-844d-c04ecc556bb9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.066071 Jul 19 09:20:34.477100 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Jul 19 09:20:34 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:20:34.498481 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-2262ede0-8d23-4161-8824-c91f2e16f84c admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:20:34.506715 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-2262ede0-8d23-4161-8824-c91f2e16f84c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011732 Jul 19 09:20:34.507260 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Mon Jul 19 09:20:34 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:20:34.518130 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-8829496d-4fc9-4a87-821c-b5f8adff1519 admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:20:34.525458 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-8829496d-4fc9-4a87-821c-b5f8adff1519 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011166 Jul 19 09:20:34.525950 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Mon Jul 19 09:20:34 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:20:34.536904 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-7f5f2f9c-c3fa-4ccf-bccc-2bf1ae554771 admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:20:34.544234 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-7f5f2f9c-c3fa-4ccf-bccc-2bf1ae554771 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011119 Jul 19 09:20:34.544729 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Mon Jul 19 09:20:34 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:20:34.554813 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-ca2a0488-37ce-4471-8d93-aebf94de5812 admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:20:34.561886 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-ca2a0488-37ce-4471-8d93-aebf94de5812 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010222 Jul 19 09:20:34.562378 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Mon Jul 19 09:20:34 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:22:01.420434 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-14b77331-074e-4b21-a5cc-bade290e6709 tempest-verify_tempest_config-260437832 tempest-verify_tempest_config-260437832-project] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:22:01.422929 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-14b77331-074e-4b21-a5cc-bade290e6709 tempest-verify_tempest_config-260437832 tempest-verify_tempest_config-260437832-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.102993 Jul 19 09:22:01.423494 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 34/69] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Jul 19 09:22:01 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:23:31.349529 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-ca2a0488-37ce-4471-8d93-aebf94de5812 admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:23:31.350528 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-ca2a0488-37ce-4471-8d93-aebf94de5812 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 19 09:23:31.350914 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 36/70] 10.222.0.16 () {56 vars in 1075 bytes} [Mon Jul 19 09:23:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:23:31.597354 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-47c9a3b4-cab7-45fb-bb51-eae778ba870e admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:23:31.598527 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:23:31.598527 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: warnings.warn(msg) Jul 19 09:23:31.600112 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_concurrency.lockutils [None req-47c9a3b4-cab7-45fb-bb51-eae778ba870e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:23:31.600547 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_concurrency.lockutils [None req-47c9a3b4-cab7-45fb-bb51-eae778ba870e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:23:31.601320 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_concurrency.lockutils [None req-47c9a3b4-cab7-45fb-bb51-eae778ba870e admin admin] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:23:31.601746 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_concurrency.lockutils [None req-47c9a3b4-cab7-45fb-bb51-eae778ba870e admin admin] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:23:31.640328 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-47c9a3b4-cab7-45fb-bb51-eae778ba870e admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.152201 Jul 19 09:23:31.640875 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 35/71] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Jul 19 09:23:31 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:23:32.965885 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: DEBUG nova.api.openstack.wsgi [None req-ca2a0488-37ce-4471-8d93-aebf94de5812 admin admin] Calling method '>' {{(pid=92626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:23:32.966879 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: INFO nova.api.openstack.requestlog [None req-ca2a0488-37ce-4471-8d93-aebf94de5812 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 19 09:23:32.967316 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: [pid: 92626|app: 0|req: 37/72] 10.222.0.16 () {56 vars in 1075 bytes} [Mon Jul 19 09:23:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:23:33.154649 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG nova.api.openstack.wsgi [None req-2f934dda-1ae3-4ed7-85e4-f1c8612abce0 admin admin] Calling method '>' {{(pid=92627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:23:33.155829 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:23:33.155829 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: warnings.warn(msg) Jul 19 09:23:33.157386 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_concurrency.lockutils [None req-2f934dda-1ae3-4ed7-85e4-f1c8612abce0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:23:33.157821 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_concurrency.lockutils [None req-2f934dda-1ae3-4ed7-85e4-f1c8612abce0 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:23:33.158600 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_concurrency.lockutils [None req-2f934dda-1ae3-4ed7-85e4-f1c8612abce0 admin admin] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:23:33.159017 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: DEBUG oslo_concurrency.lockutils [None req-2f934dda-1ae3-4ed7-85e4-f1c8612abce0 admin admin] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:23:33.181108 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: INFO nova.api.openstack.requestlog [None req-2f934dda-1ae3-4ed7-85e4-f1c8612abce0 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.076963 Jul 19 09:23:33.181687 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: [pid: 92627|app: 0|req: 36/73] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Jul 19 09:23:33 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:24:27.070234 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: Mon Jul 19 09:24:27 2021 - graceful shutdown triggered... Jul 19 09:24:27.070751 dv-cinder-793386-2-iscsi devstack@n-api.service[92626]: Gracefully killing worker 1 (pid: 92626)... Jul 19 09:24:27.071301 dv-cinder-793386-2-iscsi devstack@n-api.service[92627]: Gracefully killing worker 2 (pid: 92627)... Jul 19 09:24:27.071321 dv-cinder-793386-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 19 09:24:28.071405 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: worker 1 buried after 1 seconds Jul 19 09:24:28.071405 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: worker 2 buried after 1 seconds Jul 19 09:24:28.071405 dv-cinder-793386-2-iscsi devstack@n-api.service[92625]: goodbye to uWSGI. Jul 19 09:24:28.072860 dv-cinder-793386-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 19 09:24:28.073424 dv-cinder-793386-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 19 09:24:28.076283 dv-cinder-793386-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 09:24:28.087200 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 09:24:28.090306 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 19 09:24:28 2021] *** Jul 19 09:24:28.090306 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 09:24:28.090306 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 09:24:28.090306 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: nodename: dv-cinder-793386-2-iscsi Jul 19 09:24:28.090306 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: machine: x86_64 Jul 19 09:24:28.090306 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: clock source: unix Jul 19 09:24:28.090306 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: pcre jit disabled Jul 19 09:24:28.090306 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: detected number of CPU cores: 4 Jul 19 09:24:28.090306 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: current working directory: / Jul 19 09:24:28.090306 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: detected binary path: /usr/bin/uwsgi-core Jul 19 09:24:28.090306 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: your processes number limit is 47680 Jul 19 09:24:28.090306 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: your memory page size is 4096 bytes Jul 19 09:24:28.091253 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: detected max file descriptor number: 2048 Jul 19 09:24:28.091253 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: lock engine: pthread robust mutexes Jul 19 09:24:28.091253 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: thunder lock: enabled Jul 19 09:24:28.091253 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 09:24:28.091253 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 19 09:24:28.135560 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: Python main interpreter initialized at 0x5561386b79c0 Jul 19 09:24:28.135560 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: python threads support enabled Jul 19 09:24:28.135560 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: your server socket listen backlog is limited to 100 connections Jul 19 09:24:28.135560 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: your mercy for graceful operations on workers is 90 seconds Jul 19 09:24:28.135958 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 09:24:28.136044 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: *** Operational MODE: preforking *** Jul 19 09:24:28.136303 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: *** uWSGI is running in multiple interpreter mode *** Jul 19 09:24:28.136303 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: spawned uWSGI master process (pid: 107446) Jul 19 09:24:28.136505 dv-cinder-793386-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 19 09:24:28.138044 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: spawned uWSGI worker 1 (pid: 107463, cores: 1) Jul 19 09:24:28.138044 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: spawned uWSGI worker 2 (pid: 107464, cores: 1) Jul 19 09:24:28.138044 dv-cinder-793386-2-iscsi devstack@n-api.service[107446]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 09:24:29.912669 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 09:24:29.912669 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: from cryptography.utils import int_from_bytes Jul 19 09:24:29.913330 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 09:24:29.913330 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: from cryptography.utils import int_from_bytes Jul 19 09:24:29.918748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 09:24:29.918748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: from cryptography.utils import int_from_bytes Jul 19 09:24:29.919297 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 09:24:29.919297 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: from cryptography.utils import int_from_bytes Jul 19 09:24:32.473950 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 09:24:32.474632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 09:24:32.474632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 09:24:32.475228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 09:24:32.475228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 09:24:32.475632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.475950 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.476227 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.476560 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.476894 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.477211 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.477535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.477744 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 09:24:32.478145 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.478231 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 09:24:32.478311 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.478504 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.478607 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 09:24:32.478770 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.478871 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 09:24:32.479663 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-793386-2-iscsi {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.479782 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 09:24:32.480014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.480113 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.480315 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.480421 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.480633 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.480732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.480955 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.481069 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.481265 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.481362 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.481590 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.481747 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.481940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.482119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.482270 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.482412 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.482576 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.483796 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.484043 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.484043 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.484444 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.484444 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.484855 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-793386-2-iscsi {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.484855 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.485332 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.485549 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.485762 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.485964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.486176 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.486389 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.486624 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.486839 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.487072 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.487302 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.487536 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.487792 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.488019 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.488019 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-793386-2-iscsi {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.488431 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.488651 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.488866 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.489048 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.489262 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.489417 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.489589 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.489589 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.489923 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.490087 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.490238 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.490391 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.490575 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.490575 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.490885 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.490885 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.491206 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.491206 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.491486 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.491486 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.491780 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.491780 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.492553 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-793386-2-iscsi {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.492709 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.492861 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.493014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.493201 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.493629 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.493797 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.493949 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.494105 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.494255 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.494255 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.494591 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.494784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.494931 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.495166 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.495166 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.495449 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.495590 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.495774 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.495922 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.496073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.496225 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.496373 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.496514 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.496679 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.496838 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.496991 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.497144 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.497287 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.497439 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.497597 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.497748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.497899 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.498052 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.498193 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.498341 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.498500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.498643 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.498791 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.498940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.499109 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.499347 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.499516 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.499669 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.499817 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.499967 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.500115 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.500255 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.500410 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.500573 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.500714 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.500859 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.501000 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.501151 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.501293 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.501443 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.501590 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.501740 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.501889 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.501889 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.502200 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.502200 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.502905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.503094 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.503264 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.503408 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.503816 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.503973 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.504123 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.504123 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.504413 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.504556 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.504696 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.504860 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.505002 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.505143 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.505368 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.505518 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.505666 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.505666 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.505955 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.505955 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.506248 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.506390 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.506531 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.506531 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.506816 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.506965 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.507181 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.507334 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.507595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.507745 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.507995 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.508157 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.508310 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.508463 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.508604 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.508744 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.508901 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.509065 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.509253 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.509443 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.509595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.509736 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.509886 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.510039 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.510186 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.510333 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.510482 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.510667 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.510814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.510979 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.511160 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.511312 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.511455 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.511605 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.511760 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.511941 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.512094 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.512236 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.512382 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.512961 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.513125 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.513276 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.513428 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.513581 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.513908 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.514158 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.514315 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.514458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.514600 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.514748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.514889 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.515089 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.515238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.515379 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.515530 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.515692 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.515842 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.515994 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.516136 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.516276 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.516423 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.516574 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.516716 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.516868 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.517020 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.517168 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.517322 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.517464 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.517633 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.517776 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.517925 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.518066 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.518219 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.518367 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.518515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.518662 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.518811 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.518960 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.519132 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.519277 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.519418 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.519576 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.519724 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.519867 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.520007 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.520200 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.520350 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.520504 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.520652 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.520809 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.520959 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.521113 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.521264 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.521422 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.521574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.521722 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.521862 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.522011 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.522170 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.522312 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.522459 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.522620 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.523192 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.523363 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.523515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.523657 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.523828 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.524152 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.524383 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.524540 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.524683 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.524831 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.524980 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.525131 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.525314 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.525508 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.525665 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.526304 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.526457 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.526610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.526792 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.526946 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.527107 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.527254 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.527406 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.527562 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.527721 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.527871 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.528052 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.528206 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.528350 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.528511 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.528663 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 09:24:32.528812 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.528964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.529113 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.529268 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.529418 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.529559 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.529699 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.529846 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.529987 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.530134 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.530286 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.530445 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.530595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.530742 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.530890 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.531073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.532597 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.534004 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.534265 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.534730 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.534887 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.535078 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.535238 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.535391 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.535542 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.535694 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.535844 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.535994 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.536145 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.536287 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.536522 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.536688 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.536832 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.536986 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.537139 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.537280 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.537420 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.537570 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.537719 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.537874 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.538024 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.538167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.538308 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.538449 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.538603 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.538753 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.538912 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.539115 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.539265 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.539407 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.539564 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.539706 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.539856 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.539996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.540144 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.540286 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.540436 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.540578 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.540719 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.540879 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.541029 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.541178 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.541329 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.542103 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.542265 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.542727 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.542924 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.543101 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.543748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.543901 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.544092 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.544257 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.544496 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.544496 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.544496 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.545117 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.545259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.545408 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.545549 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.545704 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.545846 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.545994 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.546137 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.546277 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.546418 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.546577 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.546719 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.546859 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.547007 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.547184 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.547337 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.547484 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.547637 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.547788 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.547931 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.548071 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.548221 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.548379 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.548528 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.548680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.548828 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.548970 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.549123 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.549281 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.549430 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.549579 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.549722 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.549869 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.550025 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.550167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.550326 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.550474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.550616 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.550770 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.550918 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.551099 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.551248 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.551400 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.551543 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.551692 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.551834 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.551974 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.552123 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.552275 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.552424 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.552578 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.552720 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.552860 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.553009 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.553151 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.553299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.553875 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.554033 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.554184 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.554333 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.554505 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.554737 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.554908 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.555264 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.555416 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.555559 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.555707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.555862 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.556006 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.556147 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.556295 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.556437 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.556578 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.556743 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.556885 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.557049 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.557196 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.557345 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.557534 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.557719 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.557872 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.558022 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.558171 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.558321 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.558502 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.558646 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.558804 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.558985 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.559173 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.559324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.559478 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.559620 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.559769 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.559919 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.560070 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.560253 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.560409 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.560558 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.560707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.560873 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.561023 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.561173 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.561323 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.561472 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.561614 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.561762 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.561904 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.562044 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.562194 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.562343 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.562548 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.562696 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.562852 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.563009 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.563175 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.563319 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.563464 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.564028 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.564181 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.564338 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.564487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.564635 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.564861 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.565018 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.565191 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.565536 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.565811 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.565990 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.566150 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.566299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.566446 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.566669 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.566669 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.566960 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.567170 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.567322 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.567558 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.567724 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.567874 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.568029 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.568202 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.568447 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.568628 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.568789 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.568952 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.569102 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.569251 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.569405 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.569563 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.569710 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.569874 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.570030 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.570186 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.570334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.570490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.570639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.570794 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.570942 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.571106 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.571278 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.571442 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.571599 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.571746 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.571903 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.572059 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.572220 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.572376 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.572531 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.572704 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.572858 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.573015 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.573177 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.573327 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.573475 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.573475 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.574168 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.574168 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.574168 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.574750 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.574993 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.575192 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.575412 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.575766 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.575931 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.576081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.576228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.576228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.576517 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.576686 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.576835 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.576982 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.577141 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.577297 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.577462 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.577630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.577779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.577926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.578081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.578237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.578392 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.578554 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.578713 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.578860 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.579007 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.579178 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.579340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.579496 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.579646 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.579801 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.579956 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.580104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.580265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.580265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.580554 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.580712 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.580868 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.581023 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.581189 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.581337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.581492 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.581826 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.582064 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.582230 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.582395 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.582544 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.582693 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.582863 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.583012 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.583196 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.583354 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.583510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.583659 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.583806 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.584449 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.584622 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.584780 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.585128 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.585296 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.585447 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.585607 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.585954 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.586112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.586269 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.586419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.586566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.586721 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.586883 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.587061 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.587061 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.587371 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.587528 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.587693 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.587866 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.588027 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.588176 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.588851 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.589005 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.589163 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.589320 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.589468 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.589666 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.589862 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.590019 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.590178 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.590335 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.590503 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.590658 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.590807 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.590954 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.591176 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.591327 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.591482 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.591630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.591785 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.591959 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.592165 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.592363 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.592528 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.592528 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.592825 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.592984 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.593146 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.593305 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.593535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.593697 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.593847 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.594007 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.594565 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.594733 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.594883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.595096 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.595388 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.595388 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.595692 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.595864 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.596112 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.596364 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.596529 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.596679 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.596679 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.596978 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.597134 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.597134 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.597441 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.597605 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.597605 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.597892 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.598048 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.598048 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.598329 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.598477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.598477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.598781 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.598930 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.598930 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.599278 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.599583 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.599583 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.599906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.600056 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.600056 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.600344 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.600499 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.600499 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.600797 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.600946 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.600946 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.601225 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.601383 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.601383 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.601682 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.601838 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.601838 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.602133 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.602299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.602457 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.602605 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.602605 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.602892 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.603103 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.603103 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.603413 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.603562 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.603562 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.603857 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.604850 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.604850 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.605171 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.605344 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.605344 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.605770 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.605928 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.605928 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.606410 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.606658 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.606658 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.606955 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.607126 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.607126 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.607424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.607424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.607721 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.607883 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.608033 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.608180 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.608335 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.608483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.608666 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.608909 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.609065 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.609212 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.609367 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.609524 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.609682 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.609830 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.609977 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.610125 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.610280 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.610429 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.610601 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.610601 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.610882 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.610882 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.611187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.611336 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.611500 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.611656 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.611804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.611952 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.612100 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.612246 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.612407 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.612565 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.612713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.612860 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.613007 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.613163 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.613311 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.613459 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.613605 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.613762 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.613917 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.614074 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.614230 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.614378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.614539 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.615013 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.615194 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.615364 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.615662 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.616427 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.616668 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.616831 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.617077 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.617232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.617390 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.617568 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.617729 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.617886 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.618073 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.618241 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.618392 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.618549 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.618700 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.618847 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.619004 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.619203 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.619353 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.619540 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.619715 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.619864 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.620012 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.620211 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.620375 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.620525 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.620672 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.620828 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.620983 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.621132 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.621293 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.621449 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.621606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.621834 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.621989 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.622137 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.622298 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.622447 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.622595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.622744 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.622900 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.623087 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.623258 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.623408 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.623564 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.623731 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.623888 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.624045 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.624200 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.624386 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.624546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.624697 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.625205 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.625375 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.625534 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.625836 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.625991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.626148 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.626308 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.626467 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.626616 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.626872 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.627055 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.627311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.627467 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.627635 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.627785 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.627943 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.628092 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.628240 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.628388 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.628560 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.628710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.628867 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.628867 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.629395 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.629557 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.629708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.629856 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.630014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.630163 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.630468 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.630643 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.630826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.630826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.631256 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.631256 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.631541 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.631703 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.631851 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.632000 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.632148 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.632294 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.632442 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.632609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.632758 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.632905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.633064 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.633212 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.633372 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.633528 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.633683 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.633839 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.633839 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.634120 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.634277 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.634426 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.634573 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.634728 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.634887 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.635339 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.635519 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.635671 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.635982 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.636139 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.636296 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.636445 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.636671 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.636830 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.637090 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.637252 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.637500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.637683 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.637841 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.637997 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.638152 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.638301 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.638457 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.638620 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.638769 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.638991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.639229 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.639382 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.639530 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.639687 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.639847 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.639995 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.640142 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.640289 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.640447 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.640604 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.640752 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.640906 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.641061 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.641210 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.641366 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.641649 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.641820 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.641969 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.642117 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.642265 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.642422 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.642571 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.642725 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.642874 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.643028 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.643210 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.643372 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.643521 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.643671 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.643828 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.643975 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.644130 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.644355 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.644506 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.644655 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.644802 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.644956 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.645113 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.645384 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.645540 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.645697 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.645855 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.646172 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.646339 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.646497 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.646666 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.646918 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.647095 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.647252 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.647418 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.647418 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.647811 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.647811 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.648093 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.648273 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.648430 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.648579 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.648726 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.648874 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.649029 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.649029 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.649332 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.649332 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.649612 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.649612 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.649964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.650123 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.650290 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.650439 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.650587 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.650733 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.651483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.651610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.651705 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.651793 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.651888 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.651976 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.652061 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.652157 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.652244 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.652244 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.652408 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.652503 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.652604 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.652691 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.652776 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.652776 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.652924 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.653004 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.653086 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.653167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.653240 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.653318 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.653390 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.653461 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.653541 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.653614 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.653685 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.653826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.653910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.653993 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.654066 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.654137 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.654217 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.654292 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.654374 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.654459 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.654534 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.654605 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.654676 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.654746 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.654826 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.654899 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.654970 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.655337 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.655445 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.655559 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.655645 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.655727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.655808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.655888 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.655962 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.656104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.656187 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.656261 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.656333 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.656403 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.656482 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.656567 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.656641 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.656713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.656854 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.656931 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.657003 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.657087 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.657161 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.657260 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.657340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.657421 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.657508 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.657589 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.657661 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.657741 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.657822 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.657895 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.657975 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.658049 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.658121 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.658201 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.658274 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.658346 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.658430 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.658505 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.658583 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.658663 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.658737 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.658815 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.658901 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.658975 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.659535 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.659649 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.659738 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.659839 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.659941 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.660099 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.660195 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.660195 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.660360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.660470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.660559 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.660644 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.660729 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.660814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.660906 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.661001 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.661095 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.661182 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.661266 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.661358 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.661445 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.661539 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.661625 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.661711 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.661795 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.661888 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.661982 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.662069 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.662162 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.662254 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.662351 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.662438 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.662533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.662628 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.662714 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.662806 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.662901 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.662995 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.663575 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.663720 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.663844 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.663957 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.664051 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.664143 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.664225 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.664298 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.664298 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.664298 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.664298 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.664298 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.664632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.664714 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.664795 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.664867 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.664938 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.665032 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.665119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.665212 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.665305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.665390 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.665485 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.665629 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.665762 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.665852 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.665938 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.666022 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.666122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.666210 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.666295 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.666410 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.666527 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.666617 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.666712 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.666799 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.666884 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.666884 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.667113 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.667220 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.667316 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.667664 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.667751 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.667836 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.667908 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.667989 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.668071 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.668143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.668223 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.668304 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.668376 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.668376 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.668572 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.668710 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.668800 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.668885 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.668977 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.669073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.669161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.669245 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.669330 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.669421 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.669516 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.669603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.669695 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.669789 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.669876 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.669968 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.670066 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.670153 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.670238 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.670323 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.670408 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.670493 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.670588 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.670682 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.670770 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.670854 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.670946 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.671064 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.671153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.671249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.671343 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.671429 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.671514 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.671607 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.671694 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.671778 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.671964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.672067 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.672281 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.672378 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.672603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.672698 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.672924 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.673020 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.673301 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.673549 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.673650 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.673745 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.673860 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.673956 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.674190 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.674293 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.674531 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.674633 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.674848 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.674949 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.675173 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.675272 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.675504 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.675640 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.675807 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.675911 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.676118 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.676324 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.676427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.676642 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.676736 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.676977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.677073 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.677307 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.677409 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.677632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.677725 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.677949 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.678050 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.678263 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.678397 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.678574 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.678668 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.678884 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.678977 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.679218 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.679326 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.679534 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.679637 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.679847 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.679940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.680155 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.680256 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.680465 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.680571 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.680778 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.680870 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.681084 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.681177 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.681397 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.681498 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.681705 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.681797 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.682040 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.682764 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.682858 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.683136 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.683234 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.683457 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.683683 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.683870 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.683999 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.684089 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.684175 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.684391 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.684489 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.684712 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.684824 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.685029 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.685131 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.685337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.685430 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.685645 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.685754 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.685965 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.686060 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.686279 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.686528 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.686631 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.686860 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.686954 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.687205 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.687430 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.687524 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.687775 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.687871 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.688105 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.688240 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.688407 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.688507 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.688738 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.688841 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.689048 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.689150 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.689356 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.689451 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.689665 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.689761 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.689979 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.690082 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.690288 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.690400 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.690597 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.690700 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.690909 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.691004 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.691254 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.691364 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.691570 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.691672 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.691880 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.691975 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.692192 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.692303 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.692500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.692594 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.692815 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.692909 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.693122 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.693223 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.693434 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.693565 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.693752 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.693890 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.694073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.694216 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.694382 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.694476 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.694696 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.694804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.695010 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.695154 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.695420 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.695515 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.695748 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.695843 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.696065 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.696161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.696380 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.696482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.696716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.696934 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.697039 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.697254 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.697356 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.697800 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.697906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.698123 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.698272 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.698451 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.698579 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.698779 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.698873 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.699129 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.699240 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.699470 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.699566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.699816 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.699911 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.700131 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.700235 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.700461 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.700556 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.700774 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.700917 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.701088 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.701192 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.701400 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.701505 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.701713 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.701815 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.702030 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.702126 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.702346 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.702450 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.702662 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.702766 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.702976 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.703128 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.703316 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.703422 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.703632 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.703727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.703962 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.704076 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.704280 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.704381 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.704599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.704702 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.704917 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.705017 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.705236 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.705328 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.705549 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.705644 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.705861 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.705963 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.706172 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.706267 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.706499 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.706594 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.706815 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.706909 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.707193 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.707316 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.707507 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.707603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.707827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.707929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.708141 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.708311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.708449 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.708545 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.708789 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.708884 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.709108 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.709217 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.709437 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.709540 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.709752 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.709892 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.710083 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.710187 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.710397 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.710491 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.710722 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.710817 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.711054 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.711163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.711363 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.711471 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.711672 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.711767 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.711986 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.712082 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.712309 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.712410 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.712626 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.712954 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.713056 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.713774 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.713916 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.714104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.714228 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.714419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.714525 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.714750 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.714853 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.715100 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.715218 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.715412 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.715524 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.715743 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.715845 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.716064 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.716173 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.716390 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.716489 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.716706 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.716813 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.717019 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.717126 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.717330 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.717429 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.717654 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.717762 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.717967 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.718076 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.718280 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.718395 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.718585 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.718723 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.718902 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.719079 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.719235 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.719331 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.719550 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.719645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.719883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.719990 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.720196 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.720341 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.720522 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.720626 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.720834 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.720937 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.721157 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.721267 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.721469 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.721571 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.721791 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.721887 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.722065 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 09:24:32.722158 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.722418 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.722728 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.723079 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.723393 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.723705 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.724073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.724344 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.724658 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.724967 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.725292 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.725617 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.725924 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.726247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.726566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.726888 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.727227 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.727543 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.727873 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.728182 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.728497 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.728809 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.729708 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.730029 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.730346 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.730674 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.731001 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.731351 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.731680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.732028 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.732343 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.732688 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.733018 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 09:24:32.733262 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 09:24:32.744869 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_db.sqlalchemy.engines [None req-3018125d-dbee-4559-b7fd-bd719d698be3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:24:32.755002 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_db.sqlalchemy.engines [None req-96fd01cf-de79-465a-a59a-ac27e044d3de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:24:32.912144 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.context [None req-3018125d-dbee-4559-b7fd-bd719d698be3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15c05796-47fc-4258-ab4c-71158a7062ab(cell1) {{(pid=107464) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 09:24:32.916755 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3018125d-dbee-4559-b7fd-bd719d698be3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:24:32.918612 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3018125d-dbee-4559-b7fd-bd719d698be3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:24:32.919467 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3018125d-dbee-4559-b7fd-bd719d698be3 None None] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:24:32.921427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3018125d-dbee-4559-b7fd-bd719d698be3 None None] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:24:32.922519 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.context [None req-96fd01cf-de79-465a-a59a-ac27e044d3de None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15c05796-47fc-4258-ab4c-71158a7062ab(cell1) {{(pid=107463) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 09:24:32.927249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-96fd01cf-de79-465a-a59a-ac27e044d3de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:24:32.928843 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-96fd01cf-de79-465a-a59a-ac27e044d3de None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:24:32.929664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-96fd01cf-de79-465a-a59a-ac27e044d3de None None] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:24:32.931691 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-96fd01cf-de79-465a-a59a-ac27e044d3de None None] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:24:32.932063 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_db.sqlalchemy.engines [None req-3018125d-dbee-4559-b7fd-bd719d698be3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:24:32.933355 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_db.sqlalchemy.engines [None req-3018125d-dbee-4559-b7fd-bd719d698be3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:24:32.942448 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_db.sqlalchemy.engines [None req-96fd01cf-de79-465a-a59a-ac27e044d3de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:24:32.943306 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_db.sqlalchemy.engines [None req-96fd01cf-de79-465a-a59a-ac27e044d3de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:24:33.196858 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_db.sqlalchemy.engines [None req-3018125d-dbee-4559-b7fd-bd719d698be3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:24:33.208184 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_db.sqlalchemy.engines [None req-96fd01cf-de79-465a-a59a-ac27e044d3de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 09:24:33.534159 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: WARNING keystonemiddleware.auth_token [None req-3018125d-dbee-4559-b7fd-bd719d698be3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 09:24:33.540816 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: WARNING keystonemiddleware.auth_token [None req-3018125d-dbee-4559-b7fd-bd719d698be3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 09:24:33.545285 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: WARNING keystonemiddleware.auth_token [None req-96fd01cf-de79-465a-a59a-ac27e044d3de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 09:24:33.551768 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: WARNING keystonemiddleware.auth_token [None req-96fd01cf-de79-465a-a59a-ac27e044d3de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 09:24:33.885516 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: WARNING keystonemiddleware.auth_token [None req-3018125d-dbee-4559-b7fd-bd719d698be3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 09:24:33.890713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: WARNING keystonemiddleware.auth_token [None req-3018125d-dbee-4559-b7fd-bd719d698be3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 09:24:33.895906 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5561386b79c0 pid: 107464 (default app) Jul 19 09:24:33.900046 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: WARNING keystonemiddleware.auth_token [None req-96fd01cf-de79-465a-a59a-ac27e044d3de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 09:24:33.905358 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: WARNING keystonemiddleware.auth_token [None req-96fd01cf-de79-465a-a59a-ac27e044d3de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 09:24:33.910630 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5561386b79c0 pid: 107463 (default app) Jul 19 09:25:12.717163 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2cf9c776-d3e8-4a6a-ad7b-ade6e1aebe18 tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] Action: 'create', calling method: .version_select at 0x7f04b11a9430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-934150382", "metadata": {"Type": "work"}}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:12.759276 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-659049924", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452", "networks": [{"uuid": "bd1472ca-b262-4372-b083-10503903c879"}]}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:13.207224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.network.neutron [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] validate_networks() for [('bd1472ca-b262-4372-b083-10503903c879', None, None, None)] {{(pid=107464) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:25:14.119741 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2cf9c776-d3e8-4a6a-ad7b-ade6e1aebe18 tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.523349 Jul 19 09:25:14.121208 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Jul 19 09:25:11 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 2526 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 19 09:25:14.544941 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9fe2af25-8086-48d2-b088-0522525a895a tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] Action: 'create', calling method: .version_select at 0x7f04b10fe040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-953276420", "metadata": {"Type": "work"}}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:14.547400 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9fe2af25-8086-48d2-b088-0522525a895a tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:25:14.548701 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9fe2af25-8086-48d2-b088-0522525a895a tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.424899 Jul 19 09:25:14.550223 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 2/2] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Jul 19 09:25:14 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 428 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 09:25:14.558775 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-aa538a71-1d04-450a-8ae5-11cefbe79ca9 tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] Calling method '.version_select at 0x7f04b100e3a0>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:14.658573 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-aa538a71-1d04-450a-8ae5-11cefbe79ca9 tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ea063b69-8f4c-436f-bb07-6f1823677715" status: 200 len: 352 microversion: 2.1 time: 0.107077 Jul 19 09:25:14.659214 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 3/3] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Jul 19 09:25:14 2021] GET /compute/v2.1/os-volumes/ea063b69-8f4c-436f-bb07-6f1823677715 => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:25:14.670315 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-57b7f1d1-7b95-4eda-8029-f1f6261da2ef tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] Action: 'create', calling method: .version_select at 0x7f04b100eca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-152987536", "metadata": {"Type": "work"}}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:14.671940 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-57b7f1d1-7b95-4eda-8029-f1f6261da2ef tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:25:14.673621 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-57b7f1d1-7b95-4eda-8029-f1f6261da2ef tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007994 Jul 19 09:25:14.678175 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 4/4] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Jul 19 09:25:14 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 09:25:14.686737 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c9d4c571-f267-4a05-af01-25795f6178d3 tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] Action: 'create', calling method: .version_select at 0x7f04b0ffb820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-69073465", "metadata": {"Type": "work"}}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:14.688375 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c9d4c571-f267-4a05-af01-25795f6178d3 tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:25:14.689332 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c9d4c571-f267-4a05-af01-25795f6178d3 tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009661 Jul 19 09:25:14.694298 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 5/5] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Jul 19 09:25:14 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 09:25:14.699761 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-33de441a-e413-49ee-b8c7-dfd958d0d268 tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] Calling method '.version_select at 0x7f04b100e820>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:14.740366 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-33de441a-e413-49ee-b8c7-dfd958d0d268 tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] HTTP exception thrown: Volume tempest-invalid-1826189777 could not be found. Jul 19 09:25:14.741333 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-33de441a-e413-49ee-b8c7-dfd958d0d268 tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] Returning 404 to user: Volume tempest-invalid-1826189777 could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:25:14.743176 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-33de441a-e413-49ee-b8c7-dfd958d0d268 tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1826189777" status: 404 len: 99 microversion: 2.1 time: 0.046923 Jul 19 09:25:14.748724 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 6/6] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Jul 19 09:25:14 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1826189777 => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 09:25:14.760167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-53e3b0cb-e56e-424d-b796-e51a8fde8580 tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007905 Jul 19 09:25:14.762980 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 7/7] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Jul 19 09:25:14 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 09:25:14.796559 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-18e78b88-65c9-4cce-af8c-13f9a0bd405e tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.024768 Jul 19 09:25:14.798500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 8/8] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Jul 19 09:25:14 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 09:25:14.808861 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0cf399dd-1352-492b-9842-750d1bc65421 tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] Calling method '.version_select at 0x7f04b100e550>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:14.834506 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Flavor limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:25:14.835135 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Image limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:25:14.835426 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Flavor pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:25:14.835838 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Image pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:25:14.836250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:25:14.864228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:14.864893 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:14.865583 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-0cf399dd-1352-492b-9842-750d1bc65421 tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] HTTP exception thrown: Volume dde1f7fa-7ca3-49a7-972c-6fb0616412b5 could not be found. Jul 19 09:25:14.865850 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:14.866377 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:14.866680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0cf399dd-1352-492b-9842-750d1bc65421 tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] Returning 404 to user: Volume dde1f7fa-7ca3-49a7-972c-6fb0616412b5 could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:25:14.867683 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0cf399dd-1352-492b-9842-750d1bc65421 tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/dde1f7fa-7ca3-49a7-972c-6fb0616412b5" status: 404 len: 109 microversion: 2.1 time: 0.063463 Jul 19 09:25:14.868750 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 9/9] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Jul 19 09:25:14 2021] DELETE /compute/v2.1/os-volumes/dde1f7fa-7ca3-49a7-972c-6fb0616412b5 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:25:14.880104 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-01261e2a-ff48-4b42-bdc8-41dfb7ad15ae tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] Calling method '.version_select at 0x7f04b0ffb790>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:14.958336 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-01261e2a-ff48-4b42-bdc8-41dfb7ad15ae tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] HTTP exception thrown: Volume 7a70ae0f-23bf-4124-8c27-3294a072d5dd could not be found. Jul 19 09:25:14.958938 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-01261e2a-ff48-4b42-bdc8-41dfb7ad15ae tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] Returning 404 to user: Volume 7a70ae0f-23bf-4124-8c27-3294a072d5dd could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:25:14.959799 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-01261e2a-ff48-4b42-bdc8-41dfb7ad15ae tempest-VolumesNegativeTest-1150860143 tempest-VolumesNegativeTest-1150860143-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/7a70ae0f-23bf-4124-8c27-3294a072d5dd" status: 404 len: 109 microversion: 2.1 time: 0.083724 Jul 19 09:25:14.960481 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 10/10] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Jul 19 09:25:14 2021] GET /compute/v2.1/os-volumes/7a70ae0f-23bf-4124-8c27-3294a072d5dd => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 09:25:14.968090 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Getting quotas for project e08efcb8cc9a4d05b1fa155fbde3b042. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:25:14.977820 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Getting quotas for user a1f42ec475974a19bd9307d740e58e41 and project e08efcb8cc9a4d05b1fa155fbde3b042. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:25:14.990773 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Going to run 1 instances... {{(pid=107464) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:25:14.994315 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:25:15.144471 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0b432460-7a1a-49c0-858d-a26d97afab74 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.867660 Jul 19 09:25:15.151552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 1/11] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 09:25:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 3877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 09:25:15.156932 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-063264e4-4e4b-4c31-a05a-5999ec587f01 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:15.157627 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-063264e4-4e4b-4c31-a05a-5999ec587f01 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:15.445474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-063264e4-4e4b-4c31-a05a-5999ec587f01 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:15.488378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-063264e4-4e4b-4c31-a05a-5999ec587f01 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1214 microversion: 2.1 time: 0.335025 Jul 19 09:25:15.499201 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 11/12] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:15 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1214 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:15.675259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5ab4a451-fa3c-4de5-8e90-e1c146a5cb30 tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] Calling method '.version_select at 0x7f04b0f91dc0>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:15.867533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5ab4a451-fa3c-4de5-8e90-e1c146a5cb30 tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ea063b69-8f4c-436f-bb07-6f1823677715" status: 200 len: 353 microversion: 2.1 time: 0.198205 Jul 19 09:25:15.868687 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 2/13] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Jul 19 09:25:15 2021] GET /compute/v2.1/os-volumes/ea063b69-8f4c-436f-bb07-6f1823677715 => generated 353 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:25:15.879886 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-62c6a609-c9ce-497b-884d-c88ce196d473 tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] Calling method '.version_select at 0x7f04b101bc10>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:16.036472 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-62c6a609-c9ce-497b-884d-c88ce196d473 tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ea063b69-8f4c-436f-bb07-6f1823677715" status: 200 len: 353 microversion: 2.1 time: 0.160103 Jul 19 09:25:16.037116 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 12/14] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Jul 19 09:25:15 2021] GET /compute/v2.1/os-volumes/ea063b69-8f4c-436f-bb07-6f1823677715 => generated 353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:25:16.061381 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1cc728d9-de5a-4d6c-96c5-19aee1e412ee tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] Calling method '.version_select at 0x7f04b0fa1b80>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:16.213931 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1cc728d9-de5a-4d6c-96c5-19aee1e412ee tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/ea063b69-8f4c-436f-bb07-6f1823677715" status: 202 len: 0 microversion: 2.1 time: 0.163433 Jul 19 09:25:16.215068 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 3/15] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Jul 19 09:25:16 2021] DELETE /compute/v2.1/os-volumes/ea063b69-8f4c-436f-bb07-6f1823677715 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:25:16.225655 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e8b72764-4770-411a-a4da-5ffaf493a22b tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] Calling method '.version_select at 0x7f04b0fe54c0>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:16.344809 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e8b72764-4770-411a-a4da-5ffaf493a22b tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ea063b69-8f4c-436f-bb07-6f1823677715" status: 200 len: 352 microversion: 2.1 time: 0.123274 Jul 19 09:25:16.349593 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 13/16] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Jul 19 09:25:16 2021] GET /compute/v2.1/os-volumes/ea063b69-8f4c-436f-bb07-6f1823677715 => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:25:16.510570 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-dec7c6f0-6208-49c9-9743-eabef282bf9c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:16.511430 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-dec7c6f0-6208-49c9-9743-eabef282bf9c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:16.690166 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-dec7c6f0-6208-49c9-9743-eabef282bf9c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:16.717774 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-dec7c6f0-6208-49c9-9743-eabef282bf9c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1214 microversion: 2.1 time: 0.214110 Jul 19 09:25:16.719098 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 4/17] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:16 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1214 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:17.361684 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1629cdb3-05bf-4c4c-96a0-7a286184c36f tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] Calling method '.version_select at 0x7f04b0fe5ee0>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:17.433370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-1629cdb3-05bf-4c4c-96a0-7a286184c36f tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] HTTP exception thrown: Volume ea063b69-8f4c-436f-bb07-6f1823677715 could not be found. Jul 19 09:25:17.433977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1629cdb3-05bf-4c4c-96a0-7a286184c36f tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] Returning 404 to user: Volume ea063b69-8f4c-436f-bb07-6f1823677715 could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:25:17.434893 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1629cdb3-05bf-4c4c-96a0-7a286184c36f tempest-VolumesGetTestJSON-2039099821 tempest-VolumesGetTestJSON-2039099821-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ea063b69-8f4c-436f-bb07-6f1823677715" status: 404 len: 109 microversion: 2.1 time: 0.080803 Jul 19 09:25:17.441845 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 14/18] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Jul 19 09:25:17 2021] GET /compute/v2.1/os-volumes/ea063b69-8f4c-436f-bb07-6f1823677715 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:25:17.735597 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f4e17ac0-f6bd-4dc8-b150-897f7e11af00 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:17.737163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f4e17ac0-f6bd-4dc8-b150-897f7e11af00 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:17.747214 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f4e17ac0-f6bd-4dc8-b150-897f7e11af00 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:17.747672 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f4e17ac0-f6bd-4dc8-b150-897f7e11af00 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:17.748462 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f4e17ac0-f6bd-4dc8-b150-897f7e11af00 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:17.748878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f4e17ac0-f6bd-4dc8-b150-897f7e11af00 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:18.230751 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f4e17ac0-f6bd-4dc8-b150-897f7e11af00 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:18.254743 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f4e17ac0-f6bd-4dc8-b150-897f7e11af00 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1266 microversion: 2.1 time: 0.522786 Jul 19 09:25:18.256465 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 5/19] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:17 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1266 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:19.271872 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a42f290f-871d-4ef6-9734-05c05a50d64e tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:19.272481 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a42f290f-871d-4ef6-9734-05c05a50d64e tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:19.285961 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a42f290f-871d-4ef6-9734-05c05a50d64e tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:19.293214 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a42f290f-871d-4ef6-9734-05c05a50d64e tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:19.295291 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a42f290f-871d-4ef6-9734-05c05a50d64e tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:19.295762 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a42f290f-871d-4ef6-9734-05c05a50d64e tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:19.875212 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a42f290f-871d-4ef6-9734-05c05a50d64e tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:19.921056 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a42f290f-871d-4ef6-9734-05c05a50d64e tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1272 microversion: 2.1 time: 0.647674 Jul 19 09:25:19.922009 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 15/20] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:19 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1272 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:20.940290 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9a3b115c-9148-4f22-84ef-6cce567f586a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:20.940912 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9a3b115c-9148-4f22-84ef-6cce567f586a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:20.958429 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9a3b115c-9148-4f22-84ef-6cce567f586a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:20.958842 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9a3b115c-9148-4f22-84ef-6cce567f586a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:20.959677 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9a3b115c-9148-4f22-84ef-6cce567f586a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:20.960193 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9a3b115c-9148-4f22-84ef-6cce567f586a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:21.255619 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9a3b115c-9148-4f22-84ef-6cce567f586a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:21.283304 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9a3b115c-9148-4f22-84ef-6cce567f586a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1272 microversion: 2.1 time: 0.345775 Jul 19 09:25:21.285823 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 6/21] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:20 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1272 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:22.312727 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cdc3d5e0-5a2b-4150-b875-fdaa6e8e97e6 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:22.313345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-cdc3d5e0-5a2b-4150-b875-fdaa6e8e97e6 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:22.324111 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdc3d5e0-5a2b-4150-b875-fdaa6e8e97e6 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:22.325008 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdc3d5e0-5a2b-4150-b875-fdaa6e8e97e6 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:22.326612 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdc3d5e0-5a2b-4150-b875-fdaa6e8e97e6 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:22.330125 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdc3d5e0-5a2b-4150-b875-fdaa6e8e97e6 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:24.282132 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cdc3d5e0-5a2b-4150-b875-fdaa6e8e97e6 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:24.304538 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-cdc3d5e0-5a2b-4150-b875-fdaa6e8e97e6 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1314 microversion: 2.1 time: 1.999913 Jul 19 09:25:24.308830 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 16/22] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:22 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1314 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:25.326469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-66ef9641-7eb0-4ad6-9f05-7112bc53c518 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:25.327168 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-66ef9641-7eb0-4ad6-9f05-7112bc53c518 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:25.342883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-66ef9641-7eb0-4ad6-9f05-7112bc53c518 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:25.343998 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-66ef9641-7eb0-4ad6-9f05-7112bc53c518 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:25.346432 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-66ef9641-7eb0-4ad6-9f05-7112bc53c518 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:25.349717 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-66ef9641-7eb0-4ad6-9f05-7112bc53c518 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:27.513239 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-66ef9641-7eb0-4ad6-9f05-7112bc53c518 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:27.536024 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-66ef9641-7eb0-4ad6-9f05-7112bc53c518 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1314 microversion: 2.1 time: 2.213543 Jul 19 09:25:27.549335 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 7/23] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:25 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1314 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:25:28.474364 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-3bea1dfe-4014-4f4d-bbf6-60cbf193b3e7 req-2b92f476-5ee4-4b4f-a23d-33ec808d8dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba0814a9-ce63-45ad-bf11-05a9da03ef9f", "tag": "d41c9ce3-6417-46d8-a610-ce76f65f9ae9"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:28.478215 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:25:28.478215 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:25:28.495015 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-3bea1dfe-4014-4f4d-bbf6-60cbf193b3e7 req-2b92f476-5ee4-4b4f-a23d-33ec808d8dc2 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:28.495755 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-3bea1dfe-4014-4f4d-bbf6-60cbf193b3e7 req-2b92f476-5ee4-4b4f-a23d-33ec808d8dc2 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:28.522753 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-3bea1dfe-4014-4f4d-bbf6-60cbf193b3e7 req-2b92f476-5ee4-4b4f-a23d-33ec808d8dc2 service nova] Creating event network-changed:d41c9ce3-6417-46d8-a610-ce76f65f9ae9 for instance ba0814a9-ce63-45ad-bf11-05a9da03ef9f on hv-cinder-79338 Jul 19 09:25:28.524574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-3bea1dfe-4014-4f4d-bbf6-60cbf193b3e7 req-2b92f476-5ee4-4b4f-a23d-33ec808d8dc2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=107463) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 19 09:25:28.525956 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5af96762-8f76-4aa3-8bd5-c0f7a091a1ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:28.526846 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5af96762-8f76-4aa3-8bd5-c0f7a091a1ca None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:28.528454 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5af96762-8f76-4aa3-8bd5-c0f7a091a1ca None None] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:28.529671 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5af96762-8f76-4aa3-8bd5-c0f7a091a1ca None None] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:28.554670 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0078f9b4-c37f-453a-9086-f9aa842d26d1 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:28.556781 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0078f9b4-c37f-453a-9086-f9aa842d26d1 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:28.570152 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0078f9b4-c37f-453a-9086-f9aa842d26d1 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:28.570998 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0078f9b4-c37f-453a-9086-f9aa842d26d1 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:28.571485 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.compute.rpcapi [None req-5af96762-8f76-4aa3-8bd5-c0f7a091a1ca None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 19 09:25:28.572774 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5af96762-8f76-4aa3-8bd5-c0f7a091a1ca None None] Releasing lock "compute-rpcapi-router" {{(pid=107463) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 19 09:25:28.574540 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0078f9b4-c37f-453a-9086-f9aa842d26d1 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:28.576348 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0078f9b4-c37f-453a-9086-f9aa842d26d1 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:28.670340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5af96762-8f76-4aa3-8bd5-c0f7a091a1ca None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.371387 Jul 19 09:25:28.673127 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 17/24] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:25:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:25:28.986639 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0078f9b4-c37f-453a-9086-f9aa842d26d1 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:28.996514 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0078f9b4-c37f-453a-9086-f9aa842d26d1 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1314 microversion: 2.1 time: 0.446168 Jul 19 09:25:29.000438 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 8/25] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:28 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:30.017836 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5926d07c-b251-4457-af46-babbebef338b tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:30.018563 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5926d07c-b251-4457-af46-babbebef338b tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:30.038314 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5926d07c-b251-4457-af46-babbebef338b tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:30.040335 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5926d07c-b251-4457-af46-babbebef338b tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:30.041709 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5926d07c-b251-4457-af46-babbebef338b tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:30.042150 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5926d07c-b251-4457-af46-babbebef338b tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:31.097031 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5926d07c-b251-4457-af46-babbebef338b tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:31.105673 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5926d07c-b251-4457-af46-babbebef338b tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1314 microversion: 2.1 time: 1.092415 Jul 19 09:25:31.108832 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 18/26] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:30 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1314 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:25:32.129169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c7f4d376-1e54-4ce1-99c7-631d41bef64d tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:32.130812 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c7f4d376-1e54-4ce1-99c7-631d41bef64d tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:32.163930 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7f4d376-1e54-4ce1-99c7-631d41bef64d tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:32.165681 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7f4d376-1e54-4ce1-99c7-631d41bef64d tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:32.166707 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7f4d376-1e54-4ce1-99c7-631d41bef64d tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:32.168326 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7f4d376-1e54-4ce1-99c7-631d41bef64d tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:32.507890 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c7f4d376-1e54-4ce1-99c7-631d41bef64d tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:32.517710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c7f4d376-1e54-4ce1-99c7-631d41bef64d tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1314 microversion: 2.1 time: 0.395263 Jul 19 09:25:32.518360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 9/27] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:32 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:32.593521 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-dffc8b6c-cf91-4176-a44e-416a1b01acb3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'create', calling method: .version_select at 0x7f04b0e7a160>, body: {"keypair": {"name": "tempest-keypair-650278060"}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:32.699199 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-dffc8b6c-cf91-4176-a44e-416a1b01acb3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Getting quotas for project 8e21ba608b3d4e3fb2142888e5ad882b. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:25:32.715439 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-dffc8b6c-cf91-4176-a44e-416a1b01acb3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Getting quotas for user 2e227950a67d49a1a7e9a5cc85c3b7bb and project 8e21ba608b3d4e3fb2142888e5ad882b. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:25:33.219014 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-dffc8b6c-cf91-4176-a44e-416a1b01acb3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Getting quotas for project 8e21ba608b3d4e3fb2142888e5ad882b. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:25:33.227709 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-dffc8b6c-cf91-4176-a44e-416a1b01acb3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Getting quotas for user 2e227950a67d49a1a7e9a5cc85c3b7bb and project 8e21ba608b3d4e3fb2142888e5ad882b. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:25:33.255187 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-dffc8b6c-cf91-4176-a44e-416a1b01acb3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.975993 Jul 19 09:25:33.256918 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 19/28] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jul 19 09:25:32 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:33.988340 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1b2d6c96-4fca-4513-9fde-1fae4b83833c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'create', calling method: .version_select at 0x7f04b19bbb80>, body: {"keypair": {"name": "tempest-keypair-965080508"}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:34.061553 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-1b2d6c96-4fca-4513-9fde-1fae4b83833c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Getting quotas for project 2498b582b7bb4eca8ff9411d45786967. Resources: {'key_pairs'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:25:34.073645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-1b2d6c96-4fca-4513-9fde-1fae4b83833c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Getting quotas for user 96ccfe87d4084f299d97fa417b248d82 and project 2498b582b7bb4eca8ff9411d45786967. Resources: {'key_pairs'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:25:34.364949 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1447717235", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e7062567-b2cc-437a-9149-7a0166037da4"}]}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:34.517318 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.network.neutron [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] validate_networks() for [('e7062567-b2cc-437a-9149-7a0166037da4', None, None, None)] {{(pid=107463) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:25:34.866670 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-1b2d6c96-4fca-4513-9fde-1fae4b83833c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Getting quotas for project 2498b582b7bb4eca8ff9411d45786967. Resources: {'key_pairs'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:25:34.878045 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-1b2d6c96-4fca-4513-9fde-1fae4b83833c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Getting quotas for user 96ccfe87d4084f299d97fa417b248d82 and project 2498b582b7bb4eca8ff9411d45786967. Resources: {'key_pairs'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:25:34.937153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1b2d6c96-4fca-4513-9fde-1fae4b83833c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.885098 Jul 19 09:25:34.939145 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 10/29] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Jul 19 09:25:33 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1888 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jul 19 09:25:34.948105 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c72a1510-9320-4cf5-87cc-20bdb989a370 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:34.953909 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c72a1510-9320-4cf5-87cc-20bdb989a370 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:34.971884 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c72a1510-9320-4cf5-87cc-20bdb989a370 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:34.974562 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c72a1510-9320-4cf5-87cc-20bdb989a370 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:34.983302 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c72a1510-9320-4cf5-87cc-20bdb989a370 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:34.985200 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c72a1510-9320-4cf5-87cc-20bdb989a370 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:36.166893 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c72a1510-9320-4cf5-87cc-20bdb989a370 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:36.178903 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c72a1510-9320-4cf5-87cc-20bdb989a370 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1314 microversion: 2.1 time: 1.234159 Jul 19 09:25:36.191599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 11/30] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:34 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1314 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:36.878213 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Flavor limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:25:36.879225 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Image limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:25:36.879907 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Flavor pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:25:36.880460 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Image pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:25:36.881048 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:25:36.905443 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:36.905969 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:36.909999 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:36.910781 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:36.970738 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Getting quotas for project fe5dc0db33db416288959a941e0d4d0a. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:25:36.986443 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Getting quotas for user 0ea32acab08a4c08a4ef939d0617f648 and project fe5dc0db33db416288959a941e0d4d0a. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:25:37.018208 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Going to run 1 instances... {{(pid=107463) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:25:37.022312 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:25:37.157827 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b17cd8a6-4d28-48e2-905d-d65e62f00095 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.622917 Jul 19 09:25:37.158665 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 20/31] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 09:25:33 2021] POST /compute/v2.1/servers => generated 383 bytes in 3630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 09:25:37.170535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8dfb6ede-947b-47ce-8b16-9b1b561b3ea0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:37.171446 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8dfb6ede-947b-47ce-8b16-9b1b561b3ea0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:37.199430 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-eeeb9ee9-cf05-4e1d-aa26-049c9a99b166 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:37.203154 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-eeeb9ee9-cf05-4e1d-aa26-049c9a99b166 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:37.222512 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eeeb9ee9-cf05-4e1d-aa26-049c9a99b166 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:37.223073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eeeb9ee9-cf05-4e1d-aa26-049c9a99b166 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:37.227702 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eeeb9ee9-cf05-4e1d-aa26-049c9a99b166 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:37.228412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eeeb9ee9-cf05-4e1d-aa26-049c9a99b166 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:37.339175 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8dfb6ede-947b-47ce-8b16-9b1b561b3ea0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:37.351830 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8dfb6ede-947b-47ce-8b16-9b1b561b3ea0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1222 microversion: 2.1 time: 0.185779 Jul 19 09:25:37.358458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 12/32] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:37 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1222 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:37.511572 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1559253293", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e7062567-b2cc-437a-9149-7a0166037da4"}]}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:37.594099 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.network.neutron [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] validate_networks() for [('e7062567-b2cc-437a-9149-7a0166037da4', None, None, None)] {{(pid=107464) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:25:38.274833 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-eeeb9ee9-cf05-4e1d-aa26-049c9a99b166 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:38.286322 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-eeeb9ee9-cf05-4e1d-aa26-049c9a99b166 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1314 microversion: 2.1 time: 1.092982 Jul 19 09:25:38.296565 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 21/33] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:37 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1314 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:25:38.441067 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Flavor limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:25:38.442920 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Image limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:25:38.443669 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Flavor pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:25:38.444552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Image pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:25:38.454954 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:25:38.485740 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:38.487966 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:38.490827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:38.495856 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:38.568928 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Getting quotas for project fe5dc0db33db416288959a941e0d4d0a. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:25:38.583682 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Getting quotas for user 0ea32acab08a4c08a4ef939d0617f648 and project fe5dc0db33db416288959a941e0d4d0a. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:25:38.618251 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Going to run 1 instances... {{(pid=107464) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:25:38.621871 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:25:38.752220 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9781fcf2-23a0-478f-a7d8-6dffe216dd4b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.245932 Jul 19 09:25:38.753466 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 13/34] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 09:25:37 2021] POST /compute/v2.1/servers => generated 383 bytes in 1248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 09:25:38.768608 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e3b994f5-be7b-4915-be25-2f89ac307197 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:38.769229 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e3b994f5-be7b-4915-be25-2f89ac307197 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:39.046177 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e3b994f5-be7b-4915-be25-2f89ac307197 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:39.054187 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e3b994f5-be7b-4915-be25-2f89ac307197 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1222 microversion: 2.1 time: 0.294675 Jul 19 09:25:39.060964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 22/35] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:38 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1222 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:39.320414 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-99f4326a-3593-4f3c-8195-bae08ea45aef tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:39.320986 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-99f4326a-3593-4f3c-8195-bae08ea45aef tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:39.345606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-99f4326a-3593-4f3c-8195-bae08ea45aef tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:39.348494 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-99f4326a-3593-4f3c-8195-bae08ea45aef tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:39.352360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-99f4326a-3593-4f3c-8195-bae08ea45aef tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:39.353801 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-99f4326a-3593-4f3c-8195-bae08ea45aef tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:39.865612 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-99f4326a-3593-4f3c-8195-bae08ea45aef tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:39.879862 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-99f4326a-3593-4f3c-8195-bae08ea45aef tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1314 microversion: 2.1 time: 0.567868 Jul 19 09:25:39.886596 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 14/36] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:39 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:40.073981 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-959951ac-af9a-4306-b078-fef12a99f9ad tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:40.074597 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-959951ac-af9a-4306-b078-fef12a99f9ad tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:40.091076 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-959951ac-af9a-4306-b078-fef12a99f9ad tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:40.091702 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-959951ac-af9a-4306-b078-fef12a99f9ad tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:40.092585 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-959951ac-af9a-4306-b078-fef12a99f9ad tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:40.093126 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-959951ac-af9a-4306-b078-fef12a99f9ad tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:40.324964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-959951ac-af9a-4306-b078-fef12a99f9ad tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:40.334591 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-959951ac-af9a-4306-b078-fef12a99f9ad tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1218 microversion: 2.1 time: 0.262472 Jul 19 09:25:40.338520 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 23/37] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:40 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1218 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:40.458852 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-632353682", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4f0d59c1-f731-491d-9154-db4b8e66a3e5"}], "security_groups": [{"name": "tempest-securitygroup--949715117"}], "key_name": "tempest-keypair-650278060", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:40.656105 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.network.neutron [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] validate_networks() for [('4f0d59c1-f731-491d-9154-db4b8e66a3e5', None, None, None)] {{(pid=107464) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:25:40.903943 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-dc3710ef-e25c-4822-9900-9636b8af3f20 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:40.905306 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-dc3710ef-e25c-4822-9900-9636b8af3f20 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:40.912995 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dc3710ef-e25c-4822-9900-9636b8af3f20 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:40.913741 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dc3710ef-e25c-4822-9900-9636b8af3f20 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:40.914935 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dc3710ef-e25c-4822-9900-9636b8af3f20 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:40.915706 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dc3710ef-e25c-4822-9900-9636b8af3f20 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:41.217215 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-dc3710ef-e25c-4822-9900-9636b8af3f20 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:41.229923 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-dc3710ef-e25c-4822-9900-9636b8af3f20 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1314 microversion: 2.1 time: 0.329933 Jul 19 09:25:41.230530 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 24/38] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:40 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:25:41.286230 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1475927131", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1445ca09-c3c3-4dc5-bdc4-b66e9118991f"}], "security_groups": [{"name": "tempest-securitygroup--846301792"}], "key_name": "tempest-keypair-965080508", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:41.471892 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.network.neutron [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] validate_networks() for [('1445ca09-c3c3-4dc5-bdc4-b66e9118991f', None, None, None)] {{(pid=107463) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:25:42.277945 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Flavor limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:25:42.278446 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Image limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:25:42.278868 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Flavor pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:25:42.279348 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Image pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:25:42.280035 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:25:42.311225 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:42.311688 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:42.312498 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:42.312939 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:42.345687 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Getting quotas for project 2498b582b7bb4eca8ff9411d45786967. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:25:42.350216 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Getting quotas for user 96ccfe87d4084f299d97fa417b248d82 and project 2498b582b7bb4eca8ff9411d45786967. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:25:42.363377 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Going to run 1 instances... {{(pid=107463) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:25:42.366672 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:25:42.372522 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Flavor limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:25:42.373011 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Image limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:25:42.373417 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Flavor pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:25:42.374001 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Image pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:25:42.374463 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:25:42.396213 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:42.400213 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:42.401385 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:42.402471 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:42.446830 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-327b2032-a0c3-4778-9e18-ea73122a5961 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.166543 Jul 19 09:25:42.449831 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 25/39] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Jul 19 09:25:41 2021] POST /compute/v2.1/servers => generated 401 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 09:25:42.459862 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2a2abdcd-55d5-48f2-977d-c39852ee89a0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:42.474920 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2a2abdcd-55d5-48f2-977d-c39852ee89a0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:42.492975 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2a2abdcd-55d5-48f2-977d-c39852ee89a0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:42.494597 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2a2abdcd-55d5-48f2-977d-c39852ee89a0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:42.494944 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Getting quotas for project 8e21ba608b3d4e3fb2142888e5ad882b. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:25:42.496329 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2a2abdcd-55d5-48f2-977d-c39852ee89a0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:42.496962 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2a2abdcd-55d5-48f2-977d-c39852ee89a0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:42.518871 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Getting quotas for user 2e227950a67d49a1a7e9a5cc85c3b7bb and project 8e21ba608b3d4e3fb2142888e5ad882b. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:25:42.574009 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Going to run 1 instances... {{(pid=107464) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:25:42.580142 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:25:42.692074 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2a2abdcd-55d5-48f2-977d-c39852ee89a0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:42.700627 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2a2abdcd-55d5-48f2-977d-c39852ee89a0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1280 microversion: 2.1 time: 0.249567 Jul 19 09:25:42.710137 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 26/40] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:42 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1280 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:42.721517 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f17e5cad-f030-43ff-ab47-dd5ac4e8e65c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:42.722178 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f17e5cad-f030-43ff-ab47-dd5ac4e8e65c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:42.739820 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f17e5cad-f030-43ff-ab47-dd5ac4e8e65c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:42.740143 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f17e5cad-f030-43ff-ab47-dd5ac4e8e65c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:42.747642 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f17e5cad-f030-43ff-ab47-dd5ac4e8e65c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:42.752580 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f17e5cad-f030-43ff-ab47-dd5ac4e8e65c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:42.778656 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ff0642f5-6dbb-4db3-accb-21f38b7c5e5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.323592 Jul 19 09:25:42.781173 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 15/41] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 09:25:40 2021] POST /compute/v2.1/servers => generated 401 bytes in 2328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 09:25:42.797128 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e6ac80ee-09e7-4ce7-8a58-cb4f29848977 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:42.801399 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e6ac80ee-09e7-4ce7-8a58-cb4f29848977 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:43.094719 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e6ac80ee-09e7-4ce7-8a58-cb4f29848977 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:43.104992 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e6ac80ee-09e7-4ce7-8a58-cb4f29848977 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:43.125040 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e6ac80ee-09e7-4ce7-8a58-cb4f29848977 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:43.128615 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e6ac80ee-09e7-4ce7-8a58-cb4f29848977 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1281 microversion: 2.20 time: 0.344461 Jul 19 09:25:43.134393 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 16/42] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:25:42 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1281 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:25:43.178595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-64d7c4fb-773b-4352-9df3-5e413cb94f7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:43.180124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-64d7c4fb-773b-4352-9df3-5e413cb94f7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:43.269842 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f17e5cad-f030-43ff-ab47-dd5ac4e8e65c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:43.282474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f17e5cad-f030-43ff-ab47-dd5ac4e8e65c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1314 microversion: 2.1 time: 0.570490 Jul 19 09:25:43.294581 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 27/43] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:42 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:43.461254 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-64d7c4fb-773b-4352-9df3-5e413cb94f7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:43.475807 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-64d7c4fb-773b-4352-9df3-5e413cb94f7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1236 microversion: 2.1 time: 0.335166 Jul 19 09:25:43.486895 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 17/44] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:43 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1236 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:43.717338 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cc2677e6-0efc-4651-b5ac-41abbb6484ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:43.718536 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cc2677e6-0efc-4651-b5ac-41abbb6484ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:43.729139 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc2677e6-0efc-4651-b5ac-41abbb6484ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:43.729970 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc2677e6-0efc-4651-b5ac-41abbb6484ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:43.731059 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc2677e6-0efc-4651-b5ac-41abbb6484ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:43.732969 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc2677e6-0efc-4651-b5ac-41abbb6484ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:43.863225 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cc2677e6-0efc-4651-b5ac-41abbb6484ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:43.873773 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cc2677e6-0efc-4651-b5ac-41abbb6484ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1280 microversion: 2.1 time: 0.160657 Jul 19 09:25:43.880463 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 18/45] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:43 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1280 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:25:43.897354 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-555934e5-0651-48bd-8adb-788813d1874e req-3a9b72c9-67bf-43bc-ba98-db454c39fc50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba0814a9-ce63-45ad-bf11-05a9da03ef9f", "name": "network-vif-plugged", "status": "completed", "tag": "d41c9ce3-6417-46d8-a610-ce76f65f9ae9"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:43.899421 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:25:43.899421 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:25:43.907357 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-555934e5-0651-48bd-8adb-788813d1874e req-3a9b72c9-67bf-43bc-ba98-db454c39fc50 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:43.908081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-555934e5-0651-48bd-8adb-788813d1874e req-3a9b72c9-67bf-43bc-ba98-db454c39fc50 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:43.921603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-555934e5-0651-48bd-8adb-788813d1874e req-3a9b72c9-67bf-43bc-ba98-db454c39fc50 service nova] Creating event network-vif-plugged:d41c9ce3-6417-46d8-a610-ce76f65f9ae9 for instance ba0814a9-ce63-45ad-bf11-05a9da03ef9f on hv-cinder-79338 Jul 19 09:25:43.927828 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-555934e5-0651-48bd-8adb-788813d1874e req-3a9b72c9-67bf-43bc-ba98-db454c39fc50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.342127 Jul 19 09:25:43.929842 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 28/46] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:25:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:25:44.157618 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5057b01e-8eb7-4c12-8984-542a2d00ffac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:44.158240 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5057b01e-8eb7-4c12-8984-542a2d00ffac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:44.178626 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5057b01e-8eb7-4c12-8984-542a2d00ffac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:44.179463 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5057b01e-8eb7-4c12-8984-542a2d00ffac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:44.182684 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5057b01e-8eb7-4c12-8984-542a2d00ffac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:44.184353 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5057b01e-8eb7-4c12-8984-542a2d00ffac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:44.302033 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2603280b-f207-40b4-af79-d81ffbe103dc tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:44.302853 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2603280b-f207-40b4-af79-d81ffbe103dc tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:44.313206 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2603280b-f207-40b4-af79-d81ffbe103dc tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:44.317433 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2603280b-f207-40b4-af79-d81ffbe103dc tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:44.318453 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2603280b-f207-40b4-af79-d81ffbe103dc tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:44.322217 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2603280b-f207-40b4-af79-d81ffbe103dc tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:44.385588 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5057b01e-8eb7-4c12-8984-542a2d00ffac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:44.400276 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5057b01e-8eb7-4c12-8984-542a2d00ffac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:44.405411 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5057b01e-8eb7-4c12-8984-542a2d00ffac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:44.406736 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5057b01e-8eb7-4c12-8984-542a2d00ffac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1333 microversion: 2.20 time: 0.254838 Jul 19 09:25:44.409678 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 19/47] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:25:44 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1333 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:25:44.494384 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7e816af3-15b8-4fbe-b8d9-a320af07846a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:44.495426 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7e816af3-15b8-4fbe-b8d9-a320af07846a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:44.518208 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7e816af3-15b8-4fbe-b8d9-a320af07846a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:44.518770 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7e816af3-15b8-4fbe-b8d9-a320af07846a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:44.519702 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7e816af3-15b8-4fbe-b8d9-a320af07846a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:44.520210 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7e816af3-15b8-4fbe-b8d9-a320af07846a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:44.674641 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7e816af3-15b8-4fbe-b8d9-a320af07846a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:44.691100 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7e816af3-15b8-4fbe-b8d9-a320af07846a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1288 microversion: 2.1 time: 0.198125 Jul 19 09:25:44.696492 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 20/48] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:44 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1288 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:25:44.702377 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2603280b-f207-40b4-af79-d81ffbe103dc tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:44.713584 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2603280b-f207-40b4-af79-d81ffbe103dc tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1314 microversion: 2.1 time: 0.416803 Jul 19 09:25:44.717507 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 29/49] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:44 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:44.892998 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-861754cb-d7b5-44d5-915b-7498af47cd83 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:44.893957 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-861754cb-d7b5-44d5-915b-7498af47cd83 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:44.905680 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-861754cb-d7b5-44d5-915b-7498af47cd83 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:44.906868 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-861754cb-d7b5-44d5-915b-7498af47cd83 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:44.909030 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-861754cb-d7b5-44d5-915b-7498af47cd83 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:44.909804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-861754cb-d7b5-44d5-915b-7498af47cd83 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:45.428498 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ab660d58-f688-429f-a951-fc8293de22e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:45.429115 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ab660d58-f688-429f-a951-fc8293de22e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:45.437073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ab660d58-f688-429f-a951-fc8293de22e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:45.437537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ab660d58-f688-429f-a951-fc8293de22e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:45.438333 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ab660d58-f688-429f-a951-fc8293de22e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:45.438773 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ab660d58-f688-429f-a951-fc8293de22e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:45.612139 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ab660d58-f688-429f-a951-fc8293de22e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:45.622032 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ab660d58-f688-429f-a951-fc8293de22e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:45.624105 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ab660d58-f688-429f-a951-fc8293de22e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:45.625340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ab660d58-f688-429f-a951-fc8293de22e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1339 microversion: 2.20 time: 0.200924 Jul 19 09:25:45.638041 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 30/50] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:25:45 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1339 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:25:45.713042 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-06a31c73-4d76-4108-a647-098cf877a3f9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:45.713831 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-06a31c73-4d76-4108-a647-098cf877a3f9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:45.722388 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-06a31c73-4d76-4108-a647-098cf877a3f9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:45.722850 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-06a31c73-4d76-4108-a647-098cf877a3f9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:45.723723 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-06a31c73-4d76-4108-a647-098cf877a3f9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:45.724091 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-06a31c73-4d76-4108-a647-098cf877a3f9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:45.824424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-06a31c73-4d76-4108-a647-098cf877a3f9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:45.832238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-06a31c73-4d76-4108-a647-098cf877a3f9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1294 microversion: 2.1 time: 0.122841 Jul 19 09:25:45.833968 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 31/51] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:45 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1294 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:45.839596 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2c7500e6-5296-4270-924a-764f4f3c147a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:45.840485 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2c7500e6-5296-4270-924a-764f4f3c147a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:45.852156 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2c7500e6-5296-4270-924a-764f4f3c147a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:45.852609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2c7500e6-5296-4270-924a-764f4f3c147a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:45.853392 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2c7500e6-5296-4270-924a-764f4f3c147a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:45.854115 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2c7500e6-5296-4270-924a-764f4f3c147a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:45.939498 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-861754cb-d7b5-44d5-915b-7498af47cd83 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:45.954464 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-861754cb-d7b5-44d5-915b-7498af47cd83 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 1.063678 Jul 19 09:25:45.958571 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 21/52] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:44 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:46.142978 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-97b0d777-bc9c-4bd6-98c9-8587c1dcc347 req-9755fea3-552f-490d-9b5c-a662eaa64ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee4430d-0d5f-45bd-848e-aa6f05870b67", "tag": "660f7d44-fdeb-40bd-b04d-cde195c49525"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:46.146093 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:25:46.146093 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:25:46.168641 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-97b0d777-bc9c-4bd6-98c9-8587c1dcc347 req-9755fea3-552f-490d-9b5c-a662eaa64ef4 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:46.169692 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-97b0d777-bc9c-4bd6-98c9-8587c1dcc347 req-9755fea3-552f-490d-9b5c-a662eaa64ef4 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:46.211434 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-97b0d777-bc9c-4bd6-98c9-8587c1dcc347 req-9755fea3-552f-490d-9b5c-a662eaa64ef4 service nova] Creating event network-changed:660f7d44-fdeb-40bd-b04d-cde195c49525 for instance 0ee4430d-0d5f-45bd-848e-aa6f05870b67 on hv-cinder-79338 Jul 19 09:25:46.212401 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-97b0d777-bc9c-4bd6-98c9-8587c1dcc347 req-9755fea3-552f-490d-9b5c-a662eaa64ef4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=107464) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 19 09:25:46.214191 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45ae1e17-f840-43c1-b08a-ec1668b9497e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:46.227412 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45ae1e17-f840-43c1-b08a-ec1668b9497e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:46.228382 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45ae1e17-f840-43c1-b08a-ec1668b9497e None None] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:46.228836 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45ae1e17-f840-43c1-b08a-ec1668b9497e None None] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:46.252196 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.compute.rpcapi [None req-45ae1e17-f840-43c1-b08a-ec1668b9497e None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 19 09:25:46.253335 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45ae1e17-f840-43c1-b08a-ec1668b9497e None None] Releasing lock "compute-rpcapi-router" {{(pid=107464) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 19 09:25:46.307473 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-45ae1e17-f840-43c1-b08a-ec1668b9497e None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169004 Jul 19 09:25:46.308380 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 22/53] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:25:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:25:46.365811 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2c7500e6-5296-4270-924a-764f4f3c147a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:46.374217 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2c7500e6-5296-4270-924a-764f4f3c147a tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1314 microversion: 2.1 time: 0.539008 Jul 19 09:25:46.393859 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 32/54] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:45 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:46.645348 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c55cc805-4cd5-4a04-8d01-dc64623a4ea8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:46.646352 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c55cc805-4cd5-4a04-8d01-dc64623a4ea8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:46.657824 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c55cc805-4cd5-4a04-8d01-dc64623a4ea8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:46.658304 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c55cc805-4cd5-4a04-8d01-dc64623a4ea8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:46.660303 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c55cc805-4cd5-4a04-8d01-dc64623a4ea8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:46.660754 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c55cc805-4cd5-4a04-8d01-dc64623a4ea8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:46.824645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c55cc805-4cd5-4a04-8d01-dc64623a4ea8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:46.849840 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d2bc2652-755b-4b1e-83ec-f65c7c9d87de tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:46.851211 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d2bc2652-755b-4b1e-83ec-f65c7c9d87de tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:46.858582 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d2bc2652-755b-4b1e-83ec-f65c7c9d87de tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:46.862723 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c55cc805-4cd5-4a04-8d01-dc64623a4ea8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:46.867997 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d2bc2652-755b-4b1e-83ec-f65c7c9d87de tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:46.871596 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c55cc805-4cd5-4a04-8d01-dc64623a4ea8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:46.872249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d2bc2652-755b-4b1e-83ec-f65c7c9d87de tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:46.873255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d2bc2652-755b-4b1e-83ec-f65c7c9d87de tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:46.874308 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c55cc805-4cd5-4a04-8d01-dc64623a4ea8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1339 microversion: 2.20 time: 0.233850 Jul 19 09:25:46.883788 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 23/55] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:25:46 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1339 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:25:46.975237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3ef41f6e-470b-4469-8b10-86e65a2402dc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:46.976905 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3ef41f6e-470b-4469-8b10-86e65a2402dc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:46.984167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3ef41f6e-470b-4469-8b10-86e65a2402dc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:46.984921 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3ef41f6e-470b-4469-8b10-86e65a2402dc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:46.985879 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3ef41f6e-470b-4469-8b10-86e65a2402dc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:46.986691 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3ef41f6e-470b-4469-8b10-86e65a2402dc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:47.915547 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3ef41f6e-470b-4469-8b10-86e65a2402dc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:47.925686 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3ef41f6e-470b-4469-8b10-86e65a2402dc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 0.957603 Jul 19 09:25:47.926969 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 24/56] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:46 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:25:47.933957 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-19f7bf03-c96d-496c-b363-d4f50aa00543 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:47.935490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-19f7bf03-c96d-496c-b363-d4f50aa00543 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:47.963156 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-19f7bf03-c96d-496c-b363-d4f50aa00543 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:47.966067 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-19f7bf03-c96d-496c-b363-d4f50aa00543 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:47.966902 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-19f7bf03-c96d-496c-b363-d4f50aa00543 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:47.968678 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-19f7bf03-c96d-496c-b363-d4f50aa00543 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:48.224340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d2bc2652-755b-4b1e-83ec-f65c7c9d87de tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:48.254118 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d2bc2652-755b-4b1e-83ec-f65c7c9d87de tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1361 microversion: 2.1 time: 1.406497 Jul 19 09:25:48.255940 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 33/57] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:46 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1361 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:48.264344 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-74e88225-98fe-4dbd-af40-42522ff5f630 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:48.265201 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-74e88225-98fe-4dbd-af40-42522ff5f630 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:48.273508 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-74e88225-98fe-4dbd-af40-42522ff5f630 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:48.274332 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-74e88225-98fe-4dbd-af40-42522ff5f630 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:48.274726 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-74e88225-98fe-4dbd-af40-42522ff5f630 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:48.275182 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-74e88225-98fe-4dbd-af40-42522ff5f630 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:48.389717 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-74e88225-98fe-4dbd-af40-42522ff5f630 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:48.401438 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-74e88225-98fe-4dbd-af40-42522ff5f630 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:48.403285 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-74e88225-98fe-4dbd-af40-42522ff5f630 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:48.404958 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-74e88225-98fe-4dbd-af40-42522ff5f630 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1339 microversion: 2.20 time: 0.147747 Jul 19 09:25:48.405749 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 34/58] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:25:48 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1339 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:25:48.485594 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-6f5542db-b53b-4916-b3f6-f53722289700 req-8e64b85a-573b-4c87-b2de-d7c971418e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfba731a-5973-464c-b66a-ab861a0faa9a", "tag": "cd6668d4-42a5-43df-930c-788339f4d15f"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:48.487373 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:25:48.487373 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:25:48.511322 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-6f5542db-b53b-4916-b3f6-f53722289700 req-8e64b85a-573b-4c87-b2de-d7c971418e16 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:48.512049 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-6f5542db-b53b-4916-b3f6-f53722289700 req-8e64b85a-573b-4c87-b2de-d7c971418e16 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:48.523391 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-6f5542db-b53b-4916-b3f6-f53722289700 req-8e64b85a-573b-4c87-b2de-d7c971418e16 service nova] Creating event network-changed:cd6668d4-42a5-43df-930c-788339f4d15f for instance dfba731a-5973-464c-b66a-ab861a0faa9a on hv-cinder-79338 Jul 19 09:25:48.528859 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-6f5542db-b53b-4916-b3f6-f53722289700 req-8e64b85a-573b-4c87-b2de-d7c971418e16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048663 Jul 19 09:25:48.530877 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 35/59] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:25:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 09:25:48.741418 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-19f7bf03-c96d-496c-b363-d4f50aa00543 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:48.750305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-19f7bf03-c96d-496c-b363-d4f50aa00543 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1501 microversion: 2.1 time: 0.822179 Jul 19 09:25:48.751070 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 25/60] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:47 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1501 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:48.869843 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-5f1d37ef-562b-47c0-8ce8-213e4b05cbbf req-b9ad50e8-476b-422a-9f50-f01cf4b1cc92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bff3c23-e302-4420-a1fd-58fd8e80c1a1", "tag": "87db64a6-2a2a-4166-8416-043946cccae6"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:48.871907 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:25:48.871907 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:25:48.885662 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-5f1d37ef-562b-47c0-8ce8-213e4b05cbbf req-b9ad50e8-476b-422a-9f50-f01cf4b1cc92 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:48.889058 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-5f1d37ef-562b-47c0-8ce8-213e4b05cbbf req-b9ad50e8-476b-422a-9f50-f01cf4b1cc92 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:48.915380 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-5f1d37ef-562b-47c0-8ce8-213e4b05cbbf req-b9ad50e8-476b-422a-9f50-f01cf4b1cc92 service nova] Creating event network-changed:87db64a6-2a2a-4166-8416-043946cccae6 for instance 5bff3c23-e302-4420-a1fd-58fd8e80c1a1 on hv-cinder-79338 Jul 19 09:25:48.922428 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-5f1d37ef-562b-47c0-8ce8-213e4b05cbbf req-b9ad50e8-476b-422a-9f50-f01cf4b1cc92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174842 Jul 19 09:25:48.927062 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 36/61] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:25:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 09:25:48.942815 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-22097d49-0b03-47d1-b9dc-de0bb28f01a2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:48.943632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-22097d49-0b03-47d1-b9dc-de0bb28f01a2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:48.953364 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-22097d49-0b03-47d1-b9dc-de0bb28f01a2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:48.953892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-22097d49-0b03-47d1-b9dc-de0bb28f01a2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:48.954705 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-22097d49-0b03-47d1-b9dc-de0bb28f01a2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:48.955201 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-22097d49-0b03-47d1-b9dc-de0bb28f01a2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:49.165273 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-22097d49-0b03-47d1-b9dc-de0bb28f01a2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:49.177557 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-22097d49-0b03-47d1-b9dc-de0bb28f01a2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 0.239522 Jul 19 09:25:49.178914 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 26/62] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:48 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:25:49.277645 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3cb06053-b5c6-49e1-bccd-5c4712648cd1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:49.279568 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3cb06053-b5c6-49e1-bccd-5c4712648cd1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:49.291486 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3cb06053-b5c6-49e1-bccd-5c4712648cd1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:49.292689 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3cb06053-b5c6-49e1-bccd-5c4712648cd1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:49.295351 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3cb06053-b5c6-49e1-bccd-5c4712648cd1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:49.296294 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3cb06053-b5c6-49e1-bccd-5c4712648cd1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:49.432127 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-31d18c6e-ba46-4f5a-8b3c-b7872a0ff795 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:49.433594 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-31d18c6e-ba46-4f5a-8b3c-b7872a0ff795 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:49.440949 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-31d18c6e-ba46-4f5a-8b3c-b7872a0ff795 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:49.441472 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-31d18c6e-ba46-4f5a-8b3c-b7872a0ff795 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:49.442800 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-31d18c6e-ba46-4f5a-8b3c-b7872a0ff795 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:49.443597 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-31d18c6e-ba46-4f5a-8b3c-b7872a0ff795 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:49.530868 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3cb06053-b5c6-49e1-bccd-5c4712648cd1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:49.541335 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3cb06053-b5c6-49e1-bccd-5c4712648cd1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1361 microversion: 2.1 time: 0.269611 Jul 19 09:25:49.550738 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 37/63] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:49 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:25:49.631058 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-31d18c6e-ba46-4f5a-8b3c-b7872a0ff795 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:49.640441 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-31d18c6e-ba46-4f5a-8b3c-b7872a0ff795 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:49.641966 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-31d18c6e-ba46-4f5a-8b3c-b7872a0ff795 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:49.643093 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-31d18c6e-ba46-4f5a-8b3c-b7872a0ff795 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1406 microversion: 2.20 time: 0.220982 Jul 19 09:25:49.643659 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 27/64] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:25:49 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:25:50.193441 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-76894c80-6cc9-475e-840f-7735da8b4eca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:50.194145 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-76894c80-6cc9-475e-840f-7735da8b4eca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:50.199924 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-76894c80-6cc9-475e-840f-7735da8b4eca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:50.200378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-76894c80-6cc9-475e-840f-7735da8b4eca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:50.201120 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-76894c80-6cc9-475e-840f-7735da8b4eca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:50.201569 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-76894c80-6cc9-475e-840f-7735da8b4eca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:50.353687 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-76894c80-6cc9-475e-840f-7735da8b4eca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:50.362398 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-76894c80-6cc9-475e-840f-7735da8b4eca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 0.172481 Jul 19 09:25:50.363485 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 38/65] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:50 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:50.557974 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3432af31-c42a-401b-818e-db1f2e6f4a4a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:50.558767 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3432af31-c42a-401b-818e-db1f2e6f4a4a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:50.565708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3432af31-c42a-401b-818e-db1f2e6f4a4a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:50.566159 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3432af31-c42a-401b-818e-db1f2e6f4a4a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:50.566936 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3432af31-c42a-401b-818e-db1f2e6f4a4a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:50.567405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3432af31-c42a-401b-818e-db1f2e6f4a4a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:50.661393 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8e393185-2ecc-4563-984e-de8a5e6cdc8c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:50.661998 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8e393185-2ecc-4563-984e-de8a5e6cdc8c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:50.668562 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8e393185-2ecc-4563-984e-de8a5e6cdc8c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:50.669025 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8e393185-2ecc-4563-984e-de8a5e6cdc8c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:50.669785 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8e393185-2ecc-4563-984e-de8a5e6cdc8c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:50.670211 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8e393185-2ecc-4563-984e-de8a5e6cdc8c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:50.716567 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3432af31-c42a-401b-818e-db1f2e6f4a4a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:50.723734 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3432af31-c42a-401b-818e-db1f2e6f4a4a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1361 microversion: 2.1 time: 0.169790 Jul 19 09:25:50.727427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 28/66] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:50 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:50.807402 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8e393185-2ecc-4563-984e-de8a5e6cdc8c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:50.814949 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8e393185-2ecc-4563-984e-de8a5e6cdc8c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:50.816475 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8e393185-2ecc-4563-984e-de8a5e6cdc8c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:50.817550 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8e393185-2ecc-4563-984e-de8a5e6cdc8c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1406 microversion: 2.20 time: 0.159831 Jul 19 09:25:50.818119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 39/67] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:25:50 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:25:51.382947 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-13ec5c37-59e8-425d-9d20-98bb641fb815 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:51.384181 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-13ec5c37-59e8-425d-9d20-98bb641fb815 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:51.407110 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13ec5c37-59e8-425d-9d20-98bb641fb815 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:51.407538 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13ec5c37-59e8-425d-9d20-98bb641fb815 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:51.408394 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13ec5c37-59e8-425d-9d20-98bb641fb815 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:51.408845 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13ec5c37-59e8-425d-9d20-98bb641fb815 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:51.745393 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-744f502e-5a0a-452e-b8c2-c08eef07f8d1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:51.745393 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-744f502e-5a0a-452e-b8c2-c08eef07f8d1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:51.749143 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-744f502e-5a0a-452e-b8c2-c08eef07f8d1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:51.749700 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-744f502e-5a0a-452e-b8c2-c08eef07f8d1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:51.750564 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-744f502e-5a0a-452e-b8c2-c08eef07f8d1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:51.751258 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-744f502e-5a0a-452e-b8c2-c08eef07f8d1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:51.923214 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-744f502e-5a0a-452e-b8c2-c08eef07f8d1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:51.932092 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-744f502e-5a0a-452e-b8c2-c08eef07f8d1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1361 microversion: 2.1 time: 0.194889 Jul 19 09:25:51.932938 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 40/68] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:51 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:51.938913 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-59d4ebdc-8adf-40ff-aba6-b392ea3715f1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:51.939873 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-59d4ebdc-8adf-40ff-aba6-b392ea3715f1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:51.947409 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-59d4ebdc-8adf-40ff-aba6-b392ea3715f1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:51.947861 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-59d4ebdc-8adf-40ff-aba6-b392ea3715f1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:51.948906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-59d4ebdc-8adf-40ff-aba6-b392ea3715f1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:51.949336 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-59d4ebdc-8adf-40ff-aba6-b392ea3715f1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:52.028303 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-13ec5c37-59e8-425d-9d20-98bb641fb815 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:52.043159 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-13ec5c37-59e8-425d-9d20-98bb641fb815 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 0.666598 Jul 19 09:25:52.046908 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 29/69] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:51 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:52.103623 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-59d4ebdc-8adf-40ff-aba6-b392ea3715f1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:52.113424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-59d4ebdc-8adf-40ff-aba6-b392ea3715f1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:52.115220 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-59d4ebdc-8adf-40ff-aba6-b392ea3715f1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:52.116518 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-59d4ebdc-8adf-40ff-aba6-b392ea3715f1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1406 microversion: 2.20 time: 0.182238 Jul 19 09:25:52.117378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 41/70] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:25:51 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:25:52.454544 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-45c0433b-f3ee-4c82-a5bb-b541af0c3401 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14dfed2d-b202-4ea0-9981-8c34003baaae"}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:52.455900 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-45c0433b-f3ee-4c82-a5bb-b541af0c3401 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:52.462953 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45c0433b-f3ee-4c82-a5bb-b541af0c3401 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:52.463450 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45c0433b-f3ee-4c82-a5bb-b541af0c3401 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:52.464441 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45c0433b-f3ee-4c82-a5bb-b541af0c3401 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:52.464912 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45c0433b-f3ee-4c82-a5bb-b541af0c3401 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:52.670406 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-940af8ac-c4d0-4693-9081-5b756dea27f7 req-dd932176-1ecd-4201-9aab-101095c5dbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cbcf278-5d96-4715-9238-5dd27d17311d", "tag": "d8df4a87-cd9e-43a5-9d1d-ace9278bf484"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:52.672003 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:25:52.672003 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:25:52.682929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-940af8ac-c4d0-4693-9081-5b756dea27f7 req-dd932176-1ecd-4201-9aab-101095c5dbc4 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:52.683410 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-940af8ac-c4d0-4693-9081-5b756dea27f7 req-dd932176-1ecd-4201-9aab-101095c5dbc4 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:52.698390 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-940af8ac-c4d0-4693-9081-5b756dea27f7 req-dd932176-1ecd-4201-9aab-101095c5dbc4 service nova] Creating event network-changed:d8df4a87-cd9e-43a5-9d1d-ace9278bf484 for instance 5cbcf278-5d96-4715-9238-5dd27d17311d on hv-cinder-79338 Jul 19 09:25:52.705042 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-940af8ac-c4d0-4693-9081-5b756dea27f7 req-dd932176-1ecd-4201-9aab-101095c5dbc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038590 Jul 19 09:25:52.705968 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 42/71] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:25:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 09:25:52.949884 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d4e49567-fbbb-4ab7-bde0-9b16a378e9fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:52.950588 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d4e49567-fbbb-4ab7-bde0-9b16a378e9fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:52.956690 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d4e49567-fbbb-4ab7-bde0-9b16a378e9fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:52.957181 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d4e49567-fbbb-4ab7-bde0-9b16a378e9fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:52.957947 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d4e49567-fbbb-4ab7-bde0-9b16a378e9fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:52.958381 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d4e49567-fbbb-4ab7-bde0-9b16a378e9fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:53.100188 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d4e49567-fbbb-4ab7-bde0-9b16a378e9fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:53.107657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d4e49567-fbbb-4ab7-bde0-9b16a378e9fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1361 microversion: 2.1 time: 0.161721 Jul 19 09:25:53.108611 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 43/72] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:52 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:25:53.112995 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d5934c2a-8be5-4c11-aa5c-6d686fe513a4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:53.113628 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d5934c2a-8be5-4c11-aa5c-6d686fe513a4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:53.119660 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d5934c2a-8be5-4c11-aa5c-6d686fe513a4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:53.120041 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d5934c2a-8be5-4c11-aa5c-6d686fe513a4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:53.120813 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d5934c2a-8be5-4c11-aa5c-6d686fe513a4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:53.121243 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d5934c2a-8be5-4c11-aa5c-6d686fe513a4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:53.263955 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d5934c2a-8be5-4c11-aa5c-6d686fe513a4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:53.271196 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d5934c2a-8be5-4c11-aa5c-6d686fe513a4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 0.161454 Jul 19 09:25:53.271767 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 44/73] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:53 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:53.276100 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-60ff379a-3ef5-44d9-9433-47bed3e23877 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:53.276747 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-60ff379a-3ef5-44d9-9433-47bed3e23877 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:53.282091 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-60ff379a-3ef5-44d9-9433-47bed3e23877 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:53.282542 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-60ff379a-3ef5-44d9-9433-47bed3e23877 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:53.283336 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-60ff379a-3ef5-44d9-9433-47bed3e23877 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:53.283768 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-60ff379a-3ef5-44d9-9433-47bed3e23877 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:53.424487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-60ff379a-3ef5-44d9-9433-47bed3e23877 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:53.432594 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-60ff379a-3ef5-44d9-9433-47bed3e23877 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:53.434090 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-60ff379a-3ef5-44d9-9433-47bed3e23877 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:53.435186 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-60ff379a-3ef5-44d9-9433-47bed3e23877 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1406 microversion: 2.20 time: 0.162451 Jul 19 09:25:53.435762 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 45/74] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:25:53 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:25:54.125072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-68f69e1f-9ff3-4d1c-a14f-43bdaebf1570 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:54.125769 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-68f69e1f-9ff3-4d1c-a14f-43bdaebf1570 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:54.131534 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-68f69e1f-9ff3-4d1c-a14f-43bdaebf1570 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:54.132976 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-68f69e1f-9ff3-4d1c-a14f-43bdaebf1570 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:54.134600 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-68f69e1f-9ff3-4d1c-a14f-43bdaebf1570 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:54.135883 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-68f69e1f-9ff3-4d1c-a14f-43bdaebf1570 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:54.298203 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-68f69e1f-9ff3-4d1c-a14f-43bdaebf1570 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:54.306517 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-68f69e1f-9ff3-4d1c-a14f-43bdaebf1570 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1361 microversion: 2.1 time: 0.185550 Jul 19 09:25:54.307122 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 46/75] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:54 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:25:54.311403 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-02afde48-19ea-4234-8c27-4d1d8546932b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:54.312017 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-02afde48-19ea-4234-8c27-4d1d8546932b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:54.318439 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-02afde48-19ea-4234-8c27-4d1d8546932b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:54.318888 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-02afde48-19ea-4234-8c27-4d1d8546932b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:54.320672 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-02afde48-19ea-4234-8c27-4d1d8546932b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:54.321218 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-02afde48-19ea-4234-8c27-4d1d8546932b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:54.469166 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-02afde48-19ea-4234-8c27-4d1d8546932b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:54.477170 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-02afde48-19ea-4234-8c27-4d1d8546932b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 0.169076 Jul 19 09:25:54.477736 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 47/76] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:54 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:54.482265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-26110da4-b51b-4370-bd0f-f9ec2a248834 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:54.482856 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-26110da4-b51b-4370-bd0f-f9ec2a248834 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:54.489593 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26110da4-b51b-4370-bd0f-f9ec2a248834 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:54.490039 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26110da4-b51b-4370-bd0f-f9ec2a248834 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:54.490802 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26110da4-b51b-4370-bd0f-f9ec2a248834 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:54.491254 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26110da4-b51b-4370-bd0f-f9ec2a248834 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:54.659094 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-26110da4-b51b-4370-bd0f-f9ec2a248834 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:54.673261 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-26110da4-b51b-4370-bd0f-f9ec2a248834 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:54.675304 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-26110da4-b51b-4370-bd0f-f9ec2a248834 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:54.676436 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-26110da4-b51b-4370-bd0f-f9ec2a248834 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1406 microversion: 2.20 time: 0.197781 Jul 19 09:25:54.677021 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 48/77] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:25:54 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:25:54.978167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-45c0433b-f3ee-4c82-a5bb-b541af0c3401 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "POST /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.524373 Jul 19 09:25:54.978167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 30/78] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Jul 19 09:25:52 2021] POST /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f/os-volume_attachments => generated 194 bytes in 2527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 09:25:55.328266 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a09b98c2-b82a-46c6-aedb-67b60a119ee8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:55.329753 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a09b98c2-b82a-46c6-aedb-67b60a119ee8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:55.350003 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a09b98c2-b82a-46c6-aedb-67b60a119ee8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:55.350728 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a09b98c2-b82a-46c6-aedb-67b60a119ee8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:55.351598 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a09b98c2-b82a-46c6-aedb-67b60a119ee8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:55.352030 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a09b98c2-b82a-46c6-aedb-67b60a119ee8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:55.496233 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0591ebed-1970-4e1c-acad-a9b059649a7e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:55.499118 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0591ebed-1970-4e1c-acad-a9b059649a7e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:55.517914 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0591ebed-1970-4e1c-acad-a9b059649a7e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:55.518944 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0591ebed-1970-4e1c-acad-a9b059649a7e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:55.520992 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0591ebed-1970-4e1c-acad-a9b059649a7e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:55.521712 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0591ebed-1970-4e1c-acad-a9b059649a7e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:55.527836 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a09b98c2-b82a-46c6-aedb-67b60a119ee8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:55.542497 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a09b98c2-b82a-46c6-aedb-67b60a119ee8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1361 microversion: 2.1 time: 0.221116 Jul 19 09:25:55.553738 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 49/79] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:55 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:55.700878 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d1ff6a21-31e9-439a-a251-934f16d7f562 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:55.701988 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d1ff6a21-31e9-439a-a251-934f16d7f562 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:55.709487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d1ff6a21-31e9-439a-a251-934f16d7f562 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:55.710322 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d1ff6a21-31e9-439a-a251-934f16d7f562 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:55.712639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d1ff6a21-31e9-439a-a251-934f16d7f562 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:55.713694 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d1ff6a21-31e9-439a-a251-934f16d7f562 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:55.894060 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d1ff6a21-31e9-439a-a251-934f16d7f562 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:55.904439 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d1ff6a21-31e9-439a-a251-934f16d7f562 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:55.906639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d1ff6a21-31e9-439a-a251-934f16d7f562 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:55.908382 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d1ff6a21-31e9-439a-a251-934f16d7f562 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1406 microversion: 2.20 time: 0.214414 Jul 19 09:25:55.909116 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 50/80] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:25:55 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:25:56.216711 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0591ebed-1970-4e1c-acad-a9b059649a7e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:56.229564 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0591ebed-1970-4e1c-acad-a9b059649a7e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 0.739367 Jul 19 09:25:56.230167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 31/81] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:55 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:25:56.559500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0a0541a6-44d8-4cf0-9013-7c45132e0be2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:56.560854 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0a0541a6-44d8-4cf0-9013-7c45132e0be2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:56.568652 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a0541a6-44d8-4cf0-9013-7c45132e0be2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:56.569568 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a0541a6-44d8-4cf0-9013-7c45132e0be2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:56.570783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a0541a6-44d8-4cf0-9013-7c45132e0be2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:56.571502 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a0541a6-44d8-4cf0-9013-7c45132e0be2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:56.893584 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0a0541a6-44d8-4cf0-9013-7c45132e0be2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:56.908255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0a0541a6-44d8-4cf0-9013-7c45132e0be2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1361 microversion: 2.1 time: 0.352658 Jul 19 09:25:56.909848 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 51/82] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:56 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:56.930589 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c7efb5d9-ca18-404c-a85e-5c33019d1fae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:56.931753 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c7efb5d9-ca18-404c-a85e-5c33019d1fae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:56.942028 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7efb5d9-ca18-404c-a85e-5c33019d1fae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:56.943192 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7efb5d9-ca18-404c-a85e-5c33019d1fae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:56.945538 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7efb5d9-ca18-404c-a85e-5c33019d1fae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:56.946775 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7efb5d9-ca18-404c-a85e-5c33019d1fae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:57.130459 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c7efb5d9-ca18-404c-a85e-5c33019d1fae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:57.139602 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c7efb5d9-ca18-404c-a85e-5c33019d1fae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:57.140682 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c7efb5d9-ca18-404c-a85e-5c33019d1fae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:57.141988 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c7efb5d9-ca18-404c-a85e-5c33019d1fae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1406 microversion: 2.20 time: 0.218779 Jul 19 09:25:57.153212 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 32/83] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:25:56 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:25:57.172698 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-45b89d68-f158-4427-8fc0-48f22f141abf req-e7908076-3156-43c8-842d-59344019b7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee4430d-0d5f-45bd-848e-aa6f05870b67", "name": "network-vif-plugged", "status": "completed", "tag": "660f7d44-fdeb-40bd-b04d-cde195c49525"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:25:57.173942 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:25:57.173942 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:25:57.190403 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-45b89d68-f158-4427-8fc0-48f22f141abf req-e7908076-3156-43c8-842d-59344019b7f5 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:57.192080 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-45b89d68-f158-4427-8fc0-48f22f141abf req-e7908076-3156-43c8-842d-59344019b7f5 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:57.233183 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-45b89d68-f158-4427-8fc0-48f22f141abf req-e7908076-3156-43c8-842d-59344019b7f5 service nova] Creating event network-vif-plugged:660f7d44-fdeb-40bd-b04d-cde195c49525 for instance 0ee4430d-0d5f-45bd-848e-aa6f05870b67 on hv-cinder-79338 Jul 19 09:25:57.240550 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-45b89d68-f158-4427-8fc0-48f22f141abf req-e7908076-3156-43c8-842d-59344019b7f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080280 Jul 19 09:25:57.242341 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 52/84] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:25:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:25:57.249223 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bf2661b1-a24d-4eb7-9f3f-522658fd8ad2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:57.249223 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bf2661b1-a24d-4eb7-9f3f-522658fd8ad2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:57.264543 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf2661b1-a24d-4eb7-9f3f-522658fd8ad2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:57.265224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf2661b1-a24d-4eb7-9f3f-522658fd8ad2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:57.271425 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf2661b1-a24d-4eb7-9f3f-522658fd8ad2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:57.273059 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf2661b1-a24d-4eb7-9f3f-522658fd8ad2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:57.856636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bf2661b1-a24d-4eb7-9f3f-522658fd8ad2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:57.881304 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bf2661b1-a24d-4eb7-9f3f-522658fd8ad2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 0.638684 Jul 19 09:25:57.881889 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 33/85] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:57 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:57.933256 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e8ba29a6-380a-4c0b-a212-8c9e59ed3892 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:57.936935 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e8ba29a6-380a-4c0b-a212-8c9e59ed3892 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:57.952879 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e8ba29a6-380a-4c0b-a212-8c9e59ed3892 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:57.953337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e8ba29a6-380a-4c0b-a212-8c9e59ed3892 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:57.954163 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e8ba29a6-380a-4c0b-a212-8c9e59ed3892 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:57.954595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e8ba29a6-380a-4c0b-a212-8c9e59ed3892 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:58.168408 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-148b282c-a9da-4325-90b7-c393a901c20a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:58.169025 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-148b282c-a9da-4325-90b7-c393a901c20a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:58.180102 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-148b282c-a9da-4325-90b7-c393a901c20a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:58.182389 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-148b282c-a9da-4325-90b7-c393a901c20a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:58.183803 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-148b282c-a9da-4325-90b7-c393a901c20a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:58.184668 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-148b282c-a9da-4325-90b7-c393a901c20a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:58.231349 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e8ba29a6-380a-4c0b-a212-8c9e59ed3892 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:58.241381 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e8ba29a6-380a-4c0b-a212-8c9e59ed3892 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1361 microversion: 2.1 time: 0.318051 Jul 19 09:25:58.244107 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 53/86] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:57 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1361 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:58.413415 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-148b282c-a9da-4325-90b7-c393a901c20a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:58.425777 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-148b282c-a9da-4325-90b7-c393a901c20a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:58.427714 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-148b282c-a9da-4325-90b7-c393a901c20a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:58.429155 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-148b282c-a9da-4325-90b7-c393a901c20a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1406 microversion: 2.20 time: 0.272127 Jul 19 09:25:58.442988 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 34/87] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:25:58 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:25:58.902802 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8a91cb0d-b8bc-4b9e-9d92-811b82e65cd8 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:58.903425 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8a91cb0d-b8bc-4b9e-9d92-811b82e65cd8 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:58.916040 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8a91cb0d-b8bc-4b9e-9d92-811b82e65cd8 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:58.916541 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8a91cb0d-b8bc-4b9e-9d92-811b82e65cd8 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:58.917619 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8a91cb0d-b8bc-4b9e-9d92-811b82e65cd8 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:58.918048 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8a91cb0d-b8bc-4b9e-9d92-811b82e65cd8 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:59.260975 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-36c2de6c-0661-48cd-8102-3513c7e0fc16 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:59.261957 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-36c2de6c-0661-48cd-8102-3513c7e0fc16 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:59.269438 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-36c2de6c-0661-48cd-8102-3513c7e0fc16 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:59.269868 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-36c2de6c-0661-48cd-8102-3513c7e0fc16 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:59.270648 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-36c2de6c-0661-48cd-8102-3513c7e0fc16 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:59.272234 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-36c2de6c-0661-48cd-8102-3513c7e0fc16 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:59.278344 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8a91cb0d-b8bc-4b9e-9d92-811b82e65cd8 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:59.286968 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8a91cb0d-b8bc-4b9e-9d92-811b82e65cd8 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 0.389319 Jul 19 09:25:59.288535 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 54/88] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:58 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:25:59.454935 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1e1149cc-5b84-4615-a71a-662d3d0e35fe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:25:59.455790 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1e1149cc-5b84-4615-a71a-662d3d0e35fe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:25:59.464523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e1149cc-5b84-4615-a71a-662d3d0e35fe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:59.465233 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e1149cc-5b84-4615-a71a-662d3d0e35fe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:59.466370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e1149cc-5b84-4615-a71a-662d3d0e35fe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:25:59.467502 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e1149cc-5b84-4615-a71a-662d3d0e35fe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:25:59.483757 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-36c2de6c-0661-48cd-8102-3513c7e0fc16 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:59.495234 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-36c2de6c-0661-48cd-8102-3513c7e0fc16 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1361 microversion: 2.1 time: 0.237591 Jul 19 09:25:59.497195 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 35/89] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:25:59 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:25:59.646056 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1e1149cc-5b84-4615-a71a-662d3d0e35fe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:59.659812 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1e1149cc-5b84-4615-a71a-662d3d0e35fe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:59.662854 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1e1149cc-5b84-4615-a71a-662d3d0e35fe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:25:59.665939 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1e1149cc-5b84-4615-a71a-662d3d0e35fe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1406 microversion: 2.20 time: 0.219059 Jul 19 09:25:59.666880 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 55/90] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:25:59 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:26:00.305300 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9d4132e0-2dca-4aa6-b874-559101bf9b43 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:00.305982 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9d4132e0-2dca-4aa6-b874-559101bf9b43 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:00.312704 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d4132e0-2dca-4aa6-b874-559101bf9b43 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:00.313265 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d4132e0-2dca-4aa6-b874-559101bf9b43 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:00.314322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d4132e0-2dca-4aa6-b874-559101bf9b43 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:00.314973 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d4132e0-2dca-4aa6-b874-559101bf9b43 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:00.507934 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9d4132e0-2dca-4aa6-b874-559101bf9b43 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:00.519382 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c67343ab-8d52-47a2-ba9a-50f6d64c7dc2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:00.519999 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9d4132e0-2dca-4aa6-b874-559101bf9b43 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 0.218962 Jul 19 09:26:00.520136 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c67343ab-8d52-47a2-ba9a-50f6d64c7dc2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:00.523143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 36/91] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:00 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:00.531194 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c67343ab-8d52-47a2-ba9a-50f6d64c7dc2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:00.531194 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c67343ab-8d52-47a2-ba9a-50f6d64c7dc2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:00.531194 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c67343ab-8d52-47a2-ba9a-50f6d64c7dc2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:00.531194 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c67343ab-8d52-47a2-ba9a-50f6d64c7dc2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:00.684895 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-faea8e65-94b7-45e4-9993-43ae6c51deda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:00.685506 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-faea8e65-94b7-45e4-9993-43ae6c51deda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:00.695701 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-faea8e65-94b7-45e4-9993-43ae6c51deda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:00.696161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-faea8e65-94b7-45e4-9993-43ae6c51deda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:00.696945 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-faea8e65-94b7-45e4-9993-43ae6c51deda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:00.697504 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-faea8e65-94b7-45e4-9993-43ae6c51deda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:00.813472 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c67343ab-8d52-47a2-ba9a-50f6d64c7dc2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:00.821150 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c67343ab-8d52-47a2-ba9a-50f6d64c7dc2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1361 microversion: 2.1 time: 0.305400 Jul 19 09:26:00.822078 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 56/92] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:00 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1361 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:00.860479 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-faea8e65-94b7-45e4-9993-43ae6c51deda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:00.869323 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-faea8e65-94b7-45e4-9993-43ae6c51deda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:00.871181 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-faea8e65-94b7-45e4-9993-43ae6c51deda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:00.872575 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-faea8e65-94b7-45e4-9993-43ae6c51deda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1406 microversion: 2.20 time: 0.191216 Jul 19 09:26:00.873303 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 37/93] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:26:00 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:26:00.919188 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-a4da0f35-89b7-477b-b6fb-2da15d80ed7a req-f9bc4b5a-d731-4367-87f8-8e6d7438959b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bff3c23-e302-4420-a1fd-58fd8e80c1a1", "name": "network-vif-plugged", "status": "completed", "tag": "87db64a6-2a2a-4166-8416-043946cccae6"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:00.920814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:26:00.920814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:26:00.928392 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-a4da0f35-89b7-477b-b6fb-2da15d80ed7a req-f9bc4b5a-d731-4367-87f8-8e6d7438959b service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:00.929532 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-a4da0f35-89b7-477b-b6fb-2da15d80ed7a req-f9bc4b5a-d731-4367-87f8-8e6d7438959b service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:00.941056 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-a4da0f35-89b7-477b-b6fb-2da15d80ed7a req-f9bc4b5a-d731-4367-87f8-8e6d7438959b service nova] Creating event network-vif-plugged:87db64a6-2a2a-4166-8416-043946cccae6 for instance 5bff3c23-e302-4420-a1fd-58fd8e80c1a1 on hv-cinder-79338 Jul 19 09:26:00.945865 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-a4da0f35-89b7-477b-b6fb-2da15d80ed7a req-f9bc4b5a-d731-4367-87f8-8e6d7438959b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030785 Jul 19 09:26:00.946778 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 57/94] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:26:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:26:01.537854 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d9df7370-a540-4365-a901-7ae237b98436 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:01.539505 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d9df7370-a540-4365-a901-7ae237b98436 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:01.545382 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d9df7370-a540-4365-a901-7ae237b98436 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:01.545821 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d9df7370-a540-4365-a901-7ae237b98436 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:01.546578 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d9df7370-a540-4365-a901-7ae237b98436 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:01.547005 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d9df7370-a540-4365-a901-7ae237b98436 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:01.697783 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d9df7370-a540-4365-a901-7ae237b98436 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:01.704918 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d9df7370-a540-4365-a901-7ae237b98436 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 0.170695 Jul 19 09:26:01.705477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 38/95] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:01 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:01.839111 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f3c9956a-f2ef-406d-b59a-06c52ec4e89d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:01.840733 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f3c9956a-f2ef-406d-b59a-06c52ec4e89d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:01.847594 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f3c9956a-f2ef-406d-b59a-06c52ec4e89d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:01.848043 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f3c9956a-f2ef-406d-b59a-06c52ec4e89d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:01.848814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f3c9956a-f2ef-406d-b59a-06c52ec4e89d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:01.849420 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f3c9956a-f2ef-406d-b59a-06c52ec4e89d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:01.895538 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9ceca2ba-eb42-4678-b353-a63c90604a0a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:01.896430 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9ceca2ba-eb42-4678-b353-a63c90604a0a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:01.909454 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ceca2ba-eb42-4678-b353-a63c90604a0a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:01.909907 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ceca2ba-eb42-4678-b353-a63c90604a0a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:01.910698 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ceca2ba-eb42-4678-b353-a63c90604a0a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:01.912456 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ceca2ba-eb42-4678-b353-a63c90604a0a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:02.026927 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f3c9956a-f2ef-406d-b59a-06c52ec4e89d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:02.035114 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f3c9956a-f2ef-406d-b59a-06c52ec4e89d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1361 microversion: 2.1 time: 0.200918 Jul 19 09:26:02.036122 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 58/96] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:01 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:02.142605 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9ceca2ba-eb42-4678-b353-a63c90604a0a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:02.162137 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9ceca2ba-eb42-4678-b353-a63c90604a0a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:02.164284 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9ceca2ba-eb42-4678-b353-a63c90604a0a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:02.165678 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9ceca2ba-eb42-4678-b353-a63c90604a0a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1406 microversion: 2.20 time: 0.278204 Jul 19 09:26:02.166524 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 39/97] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:26:01 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:26:02.722170 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-529dd834-9ec7-4b86-be7b-2e178ee1e0ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:02.722957 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-529dd834-9ec7-4b86-be7b-2e178ee1e0ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:02.729147 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-529dd834-9ec7-4b86-be7b-2e178ee1e0ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:02.729592 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-529dd834-9ec7-4b86-be7b-2e178ee1e0ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:02.730347 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-529dd834-9ec7-4b86-be7b-2e178ee1e0ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:02.730771 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-529dd834-9ec7-4b86-be7b-2e178ee1e0ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:02.869638 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-529dd834-9ec7-4b86-be7b-2e178ee1e0ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:02.876750 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-529dd834-9ec7-4b86-be7b-2e178ee1e0ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 0.158495 Jul 19 09:26:02.877305 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 59/98] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:02 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:02.970522 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-a4f09356-a8f7-40a1-8c3c-31d97f3572af req-86c85428-34a9-4185-b2ed-e87630bdf5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfba731a-5973-464c-b66a-ab861a0faa9a", "name": "network-vif-plugged", "status": "completed", "tag": "cd6668d4-42a5-43df-930c-788339f4d15f"}, {"server_uuid": "5cbcf278-5d96-4715-9238-5dd27d17311d", "name": "network-vif-plugged", "status": "completed", "tag": "d8df4a87-cd9e-43a5-9d1d-ace9278bf484"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:02.972387 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:26:02.972387 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:26:02.979980 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-a4f09356-a8f7-40a1-8c3c-31d97f3572af req-86c85428-34a9-4185-b2ed-e87630bdf5a0 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:02.980419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-a4f09356-a8f7-40a1-8c3c-31d97f3572af req-86c85428-34a9-4185-b2ed-e87630bdf5a0 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:02.992067 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-a4f09356-a8f7-40a1-8c3c-31d97f3572af req-86c85428-34a9-4185-b2ed-e87630bdf5a0 service nova] Creating event network-vif-plugged:cd6668d4-42a5-43df-930c-788339f4d15f for instance dfba731a-5973-464c-b66a-ab861a0faa9a on hv-cinder-79338 Jul 19 09:26:02.992575 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-a4f09356-a8f7-40a1-8c3c-31d97f3572af req-86c85428-34a9-4185-b2ed-e87630bdf5a0 service nova] Creating event network-vif-plugged:d8df4a87-cd9e-43a5-9d1d-ace9278bf484 for instance 5cbcf278-5d96-4715-9238-5dd27d17311d on hv-cinder-79338 Jul 19 09:26:02.998967 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-a4f09356-a8f7-40a1-8c3c-31d97f3572af req-86c85428-34a9-4185-b2ed-e87630bdf5a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032000 Jul 19 09:26:02.999597 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 40/99] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:26:02 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:26:03.054465 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c3111b23-60d8-4f58-a8fe-201ffa92396d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:03.055099 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c3111b23-60d8-4f58-a8fe-201ffa92396d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:03.061598 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c3111b23-60d8-4f58-a8fe-201ffa92396d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:03.062055 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c3111b23-60d8-4f58-a8fe-201ffa92396d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:03.062828 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c3111b23-60d8-4f58-a8fe-201ffa92396d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:03.063295 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c3111b23-60d8-4f58-a8fe-201ffa92396d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:03.185887 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-affa2c7a-8297-4a6c-88af-ae6b6ebb8c04 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:03.186704 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-affa2c7a-8297-4a6c-88af-ae6b6ebb8c04 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:03.193970 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-affa2c7a-8297-4a6c-88af-ae6b6ebb8c04 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:03.194953 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-affa2c7a-8297-4a6c-88af-ae6b6ebb8c04 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:03.196016 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-affa2c7a-8297-4a6c-88af-ae6b6ebb8c04 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:03.196462 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-affa2c7a-8297-4a6c-88af-ae6b6ebb8c04 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:03.243372 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c3111b23-60d8-4f58-a8fe-201ffa92396d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:03.253041 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c3111b23-60d8-4f58-a8fe-201ffa92396d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1547 microversion: 2.1 time: 0.201795 Jul 19 09:26:03.253628 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 60/100] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:03 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1547 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:03.273589 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2c46b8d6-7ac7-452d-9973-6010ae64b181 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:03.274210 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2c46b8d6-7ac7-452d-9973-6010ae64b181 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:03.283102 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2c46b8d6-7ac7-452d-9973-6010ae64b181 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:03.283896 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2c46b8d6-7ac7-452d-9973-6010ae64b181 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:03.284985 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2c46b8d6-7ac7-452d-9973-6010ae64b181 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:03.286847 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2c46b8d6-7ac7-452d-9973-6010ae64b181 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:03.384690 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-affa2c7a-8297-4a6c-88af-ae6b6ebb8c04 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:03.397272 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-affa2c7a-8297-4a6c-88af-ae6b6ebb8c04 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:03.398870 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-affa2c7a-8297-4a6c-88af-ae6b6ebb8c04 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:03.400076 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-affa2c7a-8297-4a6c-88af-ae6b6ebb8c04 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1406 microversion: 2.20 time: 0.218807 Jul 19 09:26:03.411073 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 41/101] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:26:03 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:26:03.479561 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2c46b8d6-7ac7-452d-9973-6010ae64b181 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211509 Jul 19 09:26:03.480242 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 61/102] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Jul 19 09:26:03 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/os-interface => generated 284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:26:03.893974 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-15c3bcc4-c1aa-461a-892a-b81272248f63 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:03.894624 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-15c3bcc4-c1aa-461a-892a-b81272248f63 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:03.901758 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-15c3bcc4-c1aa-461a-892a-b81272248f63 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:03.902216 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-15c3bcc4-c1aa-461a-892a-b81272248f63 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:03.903000 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-15c3bcc4-c1aa-461a-892a-b81272248f63 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:03.904178 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-15c3bcc4-c1aa-461a-892a-b81272248f63 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:04.041949 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-15c3bcc4-c1aa-461a-892a-b81272248f63 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:04.049981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-15c3bcc4-c1aa-461a-892a-b81272248f63 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 0.160045 Jul 19 09:26:04.050634 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 42/103] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:03 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:04.420661 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9c5849f3-b9d0-465c-9a0a-d8e7136bf302 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:04.422252 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9c5849f3-b9d0-465c-9a0a-d8e7136bf302 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:04.431731 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9c5849f3-b9d0-465c-9a0a-d8e7136bf302 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:04.432769 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9c5849f3-b9d0-465c-9a0a-d8e7136bf302 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:04.433718 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9c5849f3-b9d0-465c-9a0a-d8e7136bf302 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:04.434697 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9c5849f3-b9d0-465c-9a0a-d8e7136bf302 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:04.758309 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9c5849f3-b9d0-465c-9a0a-d8e7136bf302 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:04.766930 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9c5849f3-b9d0-465c-9a0a-d8e7136bf302 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:04.768750 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9c5849f3-b9d0-465c-9a0a-d8e7136bf302 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:04.770082 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9c5849f3-b9d0-465c-9a0a-d8e7136bf302 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1406 microversion: 2.20 time: 0.355416 Jul 19 09:26:04.770902 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 62/104] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:26:04 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:26:05.066143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d0fcd88b-b97c-4295-9a55-04621d313565 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:05.066747 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d0fcd88b-b97c-4295-9a55-04621d313565 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:05.073228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d0fcd88b-b97c-4295-9a55-04621d313565 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:05.073675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d0fcd88b-b97c-4295-9a55-04621d313565 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:05.074439 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d0fcd88b-b97c-4295-9a55-04621d313565 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:05.074870 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d0fcd88b-b97c-4295-9a55-04621d313565 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:05.196944 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-33fbfe8e-bd51-4c2c-9f6c-0f911ba57e22 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:05.198040 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-33fbfe8e-bd51-4c2c-9f6c-0f911ba57e22 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:05.205052 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33fbfe8e-bd51-4c2c-9f6c-0f911ba57e22 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:05.205889 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33fbfe8e-bd51-4c2c-9f6c-0f911ba57e22 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:05.206901 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33fbfe8e-bd51-4c2c-9f6c-0f911ba57e22 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:05.207591 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33fbfe8e-bd51-4c2c-9f6c-0f911ba57e22 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:05.307324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d0fcd88b-b97c-4295-9a55-04621d313565 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:05.315782 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d0fcd88b-b97c-4295-9a55-04621d313565 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 0.253188 Jul 19 09:26:05.316941 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 43/105] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:05 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:05.321615 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-577f748f-7293-4606-a3b3-97dc026341eb req-660840c2-bfc5-451b-8d49-2dc7663d7220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bff3c23-e302-4420-a1fd-58fd8e80c1a1", "tag": "87db64a6-2a2a-4166-8416-043946cccae6"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:05.323454 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:26:05.323454 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:26:05.330650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-577f748f-7293-4606-a3b3-97dc026341eb req-660840c2-bfc5-451b-8d49-2dc7663d7220 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:05.331451 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-577f748f-7293-4606-a3b3-97dc026341eb req-660840c2-bfc5-451b-8d49-2dc7663d7220 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:05.349321 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-577f748f-7293-4606-a3b3-97dc026341eb req-660840c2-bfc5-451b-8d49-2dc7663d7220 service nova] Creating event network-changed:87db64a6-2a2a-4166-8416-043946cccae6 for instance 5bff3c23-e302-4420-a1fd-58fd8e80c1a1 on hv-cinder-79338 Jul 19 09:26:05.354860 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-577f748f-7293-4606-a3b3-97dc026341eb req-660840c2-bfc5-451b-8d49-2dc7663d7220 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036583 Jul 19 09:26:05.355768 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 44/106] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:26:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:26:05.726493 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-33fbfe8e-bd51-4c2c-9f6c-0f911ba57e22 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 14 microversion: 2.1 time: 0.533258 Jul 19 09:26:05.727149 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 63/107] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:05 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 14 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:26:05.790532 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-52886eac-886e-4192-be42-254d16cc20f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:05.793212 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-52886eac-886e-4192-be42-254d16cc20f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:05.802083 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52886eac-886e-4192-be42-254d16cc20f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:05.802841 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52886eac-886e-4192-be42-254d16cc20f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:05.804444 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52886eac-886e-4192-be42-254d16cc20f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:05.805077 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52886eac-886e-4192-be42-254d16cc20f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:06.333928 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-706fcd8e-ad33-4ad5-a7e6-39e2c04e5609 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:06.335263 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-706fcd8e-ad33-4ad5-a7e6-39e2c04e5609 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:06.351458 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-706fcd8e-ad33-4ad5-a7e6-39e2c04e5609 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:06.352128 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-706fcd8e-ad33-4ad5-a7e6-39e2c04e5609 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:06.354082 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-706fcd8e-ad33-4ad5-a7e6-39e2c04e5609 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:06.354571 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-706fcd8e-ad33-4ad5-a7e6-39e2c04e5609 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:06.580595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-52886eac-886e-4192-be42-254d16cc20f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:06.608460 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-52886eac-886e-4192-be42-254d16cc20f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:06.610283 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-52886eac-886e-4192-be42-254d16cc20f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:06.611767 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-52886eac-886e-4192-be42-254d16cc20f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1406 microversion: 2.20 time: 0.827111 Jul 19 09:26:06.612448 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 45/108] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:26:05 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1406 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:26:06.737172 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-804ee880-e51e-4f70-9d2d-ba78a2cd35c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:06.738111 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-804ee880-e51e-4f70-9d2d-ba78a2cd35c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:06.744799 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-804ee880-e51e-4f70-9d2d-ba78a2cd35c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:06.745256 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-804ee880-e51e-4f70-9d2d-ba78a2cd35c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:06.746049 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-804ee880-e51e-4f70-9d2d-ba78a2cd35c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:06.746492 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-804ee880-e51e-4f70-9d2d-ba78a2cd35c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:06.864362 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-804ee880-e51e-4f70-9d2d-ba78a2cd35c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 14 microversion: 2.1 time: 0.128498 Jul 19 09:26:06.868483 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 46/109] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:06 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 09:26:06.938804 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-706fcd8e-ad33-4ad5-a7e6-39e2c04e5609 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:06.949851 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-706fcd8e-ad33-4ad5-a7e6-39e2c04e5609 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1322 microversion: 2.1 time: 0.619170 Jul 19 09:26:06.950450 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 64/110] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:06 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1322 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:26:07.039076 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-13b3c42f-cfeb-4cdc-9229-4d97bc5a1ad3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:07.039987 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-13b3c42f-cfeb-4cdc-9229-4d97bc5a1ad3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:07.049278 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13b3c42f-cfeb-4cdc-9229-4d97bc5a1ad3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:07.050367 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13b3c42f-cfeb-4cdc-9229-4d97bc5a1ad3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:07.051220 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13b3c42f-cfeb-4cdc-9229-4d97bc5a1ad3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:07.051914 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13b3c42f-cfeb-4cdc-9229-4d97bc5a1ad3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:07.087734 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-13b3c42f-cfeb-4cdc-9229-4d97bc5a1ad3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Going to try to terminate instance {{(pid=107464) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:26:07.226820 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-13b3c42f-cfeb-4cdc-9229-4d97bc5a1ad3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 204 len: 0 microversion: 2.1 time: 0.192655 Jul 19 09:26:07.230576 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 47/111] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:26:07 2021] DELETE /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 09:26:07.235813 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-14528ad9-8909-423b-a09c-d36a44d4b0ff tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:07.236769 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-14528ad9-8909-423b-a09c-d36a44d4b0ff tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:07.247553 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14528ad9-8909-423b-a09c-d36a44d4b0ff tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:07.248095 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14528ad9-8909-423b-a09c-d36a44d4b0ff tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:07.248895 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14528ad9-8909-423b-a09c-d36a44d4b0ff tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:07.249337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14528ad9-8909-423b-a09c-d36a44d4b0ff tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:07.432129 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-14528ad9-8909-423b-a09c-d36a44d4b0ff tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:07.440417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-14528ad9-8909-423b-a09c-d36a44d4b0ff tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1553 microversion: 2.1 time: 0.208483 Jul 19 09:26:07.449913 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 65/112] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:07 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1553 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:07.635814 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-52fc2752-60a5-4018-9842-b59df96610f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:07.637436 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-52fc2752-60a5-4018-9842-b59df96610f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:07.644826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52fc2752-60a5-4018-9842-b59df96610f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:07.645306 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52fc2752-60a5-4018-9842-b59df96610f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:07.646326 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52fc2752-60a5-4018-9842-b59df96610f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:07.646806 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52fc2752-60a5-4018-9842-b59df96610f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:07.828097 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-52fc2752-60a5-4018-9842-b59df96610f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:07.836746 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-52fc2752-60a5-4018-9842-b59df96610f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:07.838419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-52fc2752-60a5-4018-9842-b59df96610f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:07.839703 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-52fc2752-60a5-4018-9842-b59df96610f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1406 microversion: 2.20 time: 0.211149 Jul 19 09:26:07.840382 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 48/113] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:26:07 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:26:07.878674 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d5193ae9-f1b8-4ff1-ba3a-d85252717ceb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:07.880004 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d5193ae9-f1b8-4ff1-ba3a-d85252717ceb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:07.888611 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d5193ae9-f1b8-4ff1-ba3a-d85252717ceb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:07.892422 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d5193ae9-f1b8-4ff1-ba3a-d85252717ceb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:07.893338 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d5193ae9-f1b8-4ff1-ba3a-d85252717ceb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:07.893973 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d5193ae9-f1b8-4ff1-ba3a-d85252717ceb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:07.966776 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-af76c787-42c0-49c8-a59d-2faafb27d079 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:07.967611 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-af76c787-42c0-49c8-a59d-2faafb27d079 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:07.975354 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-af76c787-42c0-49c8-a59d-2faafb27d079 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:07.975912 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-af76c787-42c0-49c8-a59d-2faafb27d079 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:07.976787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-af76c787-42c0-49c8-a59d-2faafb27d079 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:07.977310 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-af76c787-42c0-49c8-a59d-2faafb27d079 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:08.024705 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d5193ae9-f1b8-4ff1-ba3a-d85252717ceb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 14 microversion: 2.1 time: 0.149711 Jul 19 09:26:08.029185 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 66/114] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:07 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:26:08.117584 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-af76c787-42c0-49c8-a59d-2faafb27d079 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:08.125384 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-af76c787-42c0-49c8-a59d-2faafb27d079 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1517 microversion: 2.1 time: 0.163039 Jul 19 09:26:08.126177 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 49/115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:07 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:08.144964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6446f1c3-e52b-4e00-9270-d312ecc7078e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:08.146089 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6446f1c3-e52b-4e00-9270-d312ecc7078e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:08.152500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6446f1c3-e52b-4e00-9270-d312ecc7078e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:08.152954 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6446f1c3-e52b-4e00-9270-d312ecc7078e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:08.153716 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6446f1c3-e52b-4e00-9270-d312ecc7078e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:08.154153 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6446f1c3-e52b-4e00-9270-d312ecc7078e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:08.177641 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.objects.instance [None req-6446f1c3-e52b-4e00-9270-d312ecc7078e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lazy-loading 'flavor' on Instance uuid dfba731a-5973-464c-b66a-ab861a0faa9a {{(pid=107463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:26:08.287507 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6446f1c3-e52b-4e00-9270-d312ecc7078e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "POST /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a/action" status: 200 len: 32 microversion: 2.1 time: 0.147532 Jul 19 09:26:08.288107 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 67/116] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:08 2021] POST /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a/action => generated 32 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:26:08.297494 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-79cd5903-74b7-46c2-bd94-fe864c33d23e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:08.298205 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-79cd5903-74b7-46c2-bd94-fe864c33d23e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:08.304589 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79cd5903-74b7-46c2-bd94-fe864c33d23e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:08.305133 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79cd5903-74b7-46c2-bd94-fe864c33d23e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:08.305992 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79cd5903-74b7-46c2-bd94-fe864c33d23e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:08.306438 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79cd5903-74b7-46c2-bd94-fe864c33d23e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:08.457945 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e797d180-8b89-4ecb-a222-5fc9eaca2711 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:08.458641 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e797d180-8b89-4ecb-a222-5fc9eaca2711 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:08.465431 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e797d180-8b89-4ecb-a222-5fc9eaca2711 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:08.466006 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e797d180-8b89-4ecb-a222-5fc9eaca2711 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:08.466784 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e797d180-8b89-4ecb-a222-5fc9eaca2711 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:08.467294 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e797d180-8b89-4ecb-a222-5fc9eaca2711 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:08.541189 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-79cd5903-74b7-46c2-bd94-fe864c33d23e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:08.550160 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-79cd5903-74b7-46c2-bd94-fe864c33d23e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.256462 Jul 19 09:26:08.550761 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 50/117] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:08 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:08.610901 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e797d180-8b89-4ecb-a222-5fc9eaca2711 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:08.618665 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e797d180-8b89-4ecb-a222-5fc9eaca2711 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1553 microversion: 2.1 time: 0.164626 Jul 19 09:26:08.619260 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 68/118] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:08 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:26:08.857943 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-32e095dc-70a2-4bab-ab06-8676d1422d8a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:08.858777 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-32e095dc-70a2-4bab-ab06-8676d1422d8a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:08.864630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32e095dc-70a2-4bab-ab06-8676d1422d8a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:08.865287 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32e095dc-70a2-4bab-ab06-8676d1422d8a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:08.866578 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32e095dc-70a2-4bab-ab06-8676d1422d8a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:08.867204 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32e095dc-70a2-4bab-ab06-8676d1422d8a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:09.032063 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-316298115", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452", "networks": [{"uuid": "eb5cf022-63e0-4d71-8824-54a92c2210b1"}]}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:09.100470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.network.neutron [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] validate_networks() for [('eb5cf022-63e0-4d71-8824-54a92c2210b1', None, None, None)] {{(pid=107463) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:26:09.230615 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-32e095dc-70a2-4bab-ab06-8676d1422d8a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:09.240574 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-32e095dc-70a2-4bab-ab06-8676d1422d8a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:09.245623 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-32e095dc-70a2-4bab-ab06-8676d1422d8a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:09.247000 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-32e095dc-70a2-4bab-ab06-8676d1422d8a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1598 microversion: 2.20 time: 0.392864 Jul 19 09:26:09.259804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 51/119] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:26:08 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1598 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:26:09.266727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-638bab4a-f4cc-4eb8-8afa-cf9d6dabc87c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:09.267664 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-638bab4a-f4cc-4eb8-8afa-cf9d6dabc87c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:09.273505 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-638bab4a-f4cc-4eb8-8afa-cf9d6dabc87c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:09.273954 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-638bab4a-f4cc-4eb8-8afa-cf9d6dabc87c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:09.274724 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-638bab4a-f4cc-4eb8-8afa-cf9d6dabc87c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:09.275195 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-638bab4a-f4cc-4eb8-8afa-cf9d6dabc87c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:09.342018 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-638bab4a-f4cc-4eb8-8afa-cf9d6dabc87c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 14 microversion: 2.1 time: 0.080631 Jul 19 09:26:09.342847 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 52/120] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:09 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:26:09.347923 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a7223de8-5c0f-4a9f-a964-1384e4643835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:09.348690 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a7223de8-5c0f-4a9f-a964-1384e4643835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:09.355843 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a7223de8-5c0f-4a9f-a964-1384e4643835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:09.356300 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a7223de8-5c0f-4a9f-a964-1384e4643835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:09.357118 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a7223de8-5c0f-4a9f-a964-1384e4643835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:09.357561 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a7223de8-5c0f-4a9f-a964-1384e4643835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:09.465994 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a7223de8-5c0f-4a9f-a964-1384e4643835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.122048 Jul 19 09:26:09.466589 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 53/121] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Jul 19 09:26:09 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:26:09.571769 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b600a49c-6b83-47c4-8091-1f3e90893bdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:09.572604 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b600a49c-6b83-47c4-8091-1f3e90893bdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:09.578626 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b600a49c-6b83-47c4-8091-1f3e90893bdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:09.579118 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b600a49c-6b83-47c4-8091-1f3e90893bdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:09.579906 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b600a49c-6b83-47c4-8091-1f3e90893bdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:09.580345 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b600a49c-6b83-47c4-8091-1f3e90893bdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:09.600564 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Flavor limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:26:09.601248 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Image limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:26:09.601936 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Flavor pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:26:09.602913 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Image pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:26:09.603982 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:26:09.614395 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:09.614913 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:09.616370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:09.616874 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:09.635714 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Getting quotas for project 3197460e0e344400b48795ca25fbd373. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:26:09.640166 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Getting quotas for user a7ec3e6c648a43ba91287cda79019993 and project 3197460e0e344400b48795ca25fbd373. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:26:09.651256 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Going to run 1 instances... {{(pid=107463) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:26:09.654656 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:26:09.746265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-df07cb61-6024-4a99-abe9-6bce46561e52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.724054 Jul 19 09:26:09.751801 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b600a49c-6b83-47c4-8091-1f3e90893bdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:09.760369 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b600a49c-6b83-47c4-8091-1f3e90893bdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.195731 Jul 19 09:26:09.761393 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 54/122] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:09 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:26:09.766170 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-08cf96b4-6738-4efd-ba66-f7721a3d41c7 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:09.767191 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-08cf96b4-6738-4efd-ba66-f7721a3d41c7 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:09.772696 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 69/123] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 09:26:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 09:26:09.775561 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08cf96b4-6738-4efd-ba66-f7721a3d41c7 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:09.776466 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08cf96b4-6738-4efd-ba66-f7721a3d41c7 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:09.776628 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-711635c9-84a9-49e6-bf7d-2ad5bfc40f59 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:09.777214 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-711635c9-84a9-49e6-bf7d-2ad5bfc40f59 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:09.778316 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08cf96b4-6738-4efd-ba66-f7721a3d41c7 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:09.778949 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08cf96b4-6738-4efd-ba66-f7721a3d41c7 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:09.865224 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-711635c9-84a9-49e6-bf7d-2ad5bfc40f59 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:09.874509 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-711635c9-84a9-49e6-bf7d-2ad5bfc40f59 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1218 microversion: 2.1 time: 0.101391 Jul 19 09:26:09.878443 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 70/124] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:09 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:09.972118 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-08cf96b4-6738-4efd-ba66-f7721a3d41c7 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:09.982231 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-08cf96b4-6738-4efd-ba66-f7721a3d41c7 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1553 microversion: 2.1 time: 0.219509 Jul 19 09:26:09.992677 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 55/125] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:09 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1553 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:10.356039 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-996b9c48-136e-4f4f-bf98-c11cc794b757 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:10.357264 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-996b9c48-136e-4f4f-bf98-c11cc794b757 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:10.368179 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-996b9c48-136e-4f4f-bf98-c11cc794b757 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:10.371090 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-996b9c48-136e-4f4f-bf98-c11cc794b757 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:10.373773 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-996b9c48-136e-4f4f-bf98-c11cc794b757 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:10.374291 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-996b9c48-136e-4f4f-bf98-c11cc794b757 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:10.481021 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-996b9c48-136e-4f4f-bf98-c11cc794b757 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 14 microversion: 2.1 time: 0.131104 Jul 19 09:26:10.484657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 71/126] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:10 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:26:10.705875 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-18f94d28-6618-41b1-8653-93f74a9d5a34 req-9be31fad-fb9c-44d2-8fe5-acd74833b39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cbcf278-5d96-4715-9238-5dd27d17311d", "tag": "d8df4a87-cd9e-43a5-9d1d-ace9278bf484"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:10.707405 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:26:10.707405 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:26:10.709400 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-51368882-9908-4d82-ad1c-05df46445dde tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:10.711406 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-51368882-9908-4d82-ad1c-05df46445dde tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:10.722171 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-18f94d28-6618-41b1-8653-93f74a9d5a34 req-9be31fad-fb9c-44d2-8fe5-acd74833b39b service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:10.722807 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-18f94d28-6618-41b1-8653-93f74a9d5a34 req-9be31fad-fb9c-44d2-8fe5-acd74833b39b service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:10.734867 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-51368882-9908-4d82-ad1c-05df46445dde tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:10.736400 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-51368882-9908-4d82-ad1c-05df46445dde tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:10.737328 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-51368882-9908-4d82-ad1c-05df46445dde tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:10.737830 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-18f94d28-6618-41b1-8653-93f74a9d5a34 req-9be31fad-fb9c-44d2-8fe5-acd74833b39b service nova] Creating event network-changed:d8df4a87-cd9e-43a5-9d1d-ace9278bf484 for instance 5cbcf278-5d96-4715-9238-5dd27d17311d on hv-cinder-79338 Jul 19 09:26:10.739424 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-51368882-9908-4d82-ad1c-05df46445dde tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:10.744682 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-18f94d28-6618-41b1-8653-93f74a9d5a34 req-9be31fad-fb9c-44d2-8fe5-acd74833b39b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042357 Jul 19 09:26:10.745682 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 72/127] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:26:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:26:10.779452 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e1ed39a8-aac7-471e-9937-7e13ec60cf42 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:10.780158 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e1ed39a8-aac7-471e-9937-7e13ec60cf42 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:10.789381 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e1ed39a8-aac7-471e-9937-7e13ec60cf42 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:10.789834 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e1ed39a8-aac7-471e-9937-7e13ec60cf42 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:10.790623 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e1ed39a8-aac7-471e-9937-7e13ec60cf42 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:10.791083 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e1ed39a8-aac7-471e-9937-7e13ec60cf42 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:10.843290 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-51368882-9908-4d82-ad1c-05df46445dde tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 14 microversion: 2.20 time: 0.145209 Jul 19 09:26:10.847532 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 56/128] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:10 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:10.900595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a855327b-6ac7-4beb-8e36-b9f43f9d95cd tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:10.901328 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a855327b-6ac7-4beb-8e36-b9f43f9d95cd tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:10.921820 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a855327b-6ac7-4beb-8e36-b9f43f9d95cd tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:10.922517 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a855327b-6ac7-4beb-8e36-b9f43f9d95cd tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:10.923566 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a855327b-6ac7-4beb-8e36-b9f43f9d95cd tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:10.923992 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a855327b-6ac7-4beb-8e36-b9f43f9d95cd tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:11.057099 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e1ed39a8-aac7-471e-9937-7e13ec60cf42 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:11.064487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e1ed39a8-aac7-471e-9937-7e13ec60cf42 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.289598 Jul 19 09:26:11.078394 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 73/129] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:10 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:11.083386 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-56b82cc4-88a9-45d9-9954-8d3a60112ad5 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:11.084238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-56b82cc4-88a9-45d9-9954-8d3a60112ad5 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:11.090056 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-56b82cc4-88a9-45d9-9954-8d3a60112ad5 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:11.090701 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-56b82cc4-88a9-45d9-9954-8d3a60112ad5 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:11.091684 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-56b82cc4-88a9-45d9-9954-8d3a60112ad5 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:11.092265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-56b82cc4-88a9-45d9-9954-8d3a60112ad5 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:11.124583 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a855327b-6ac7-4beb-8e36-b9f43f9d95cd tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:11.140237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a855327b-6ac7-4beb-8e36-b9f43f9d95cd tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1270 microversion: 2.1 time: 0.243315 Jul 19 09:26:11.143742 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 57/130] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:10 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1270 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:11.178072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-56b82cc4-88a9-45d9-9954-8d3a60112ad5 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:11.186763 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-56b82cc4-88a9-45d9-9954-8d3a60112ad5 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1511 microversion: 2.1 time: 0.107060 Jul 19 09:26:11.187702 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 74/131] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:11 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1511 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:11.345379 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-677188ee-20e6-427c-89b0-4f96de4b99b0 req-31f9e9da-6f64-4eb7-b660-7846fa5da885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba0814a9-ce63-45ad-bf11-05a9da03ef9f", "name": "network-vif-deleted", "tag": "d41c9ce3-6417-46d8-a610-ce76f65f9ae9"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:11.347610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:26:11.347610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:26:11.366938 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-677188ee-20e6-427c-89b0-4f96de4b99b0 req-31f9e9da-6f64-4eb7-b660-7846fa5da885 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:11.367835 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-677188ee-20e6-427c-89b0-4f96de4b99b0 req-31f9e9da-6f64-4eb7-b660-7846fa5da885 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:11.398878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-677188ee-20e6-427c-89b0-4f96de4b99b0 req-31f9e9da-6f64-4eb7-b660-7846fa5da885 service nova] Creating event network-vif-deleted:d41c9ce3-6417-46d8-a610-ce76f65f9ae9 for instance ba0814a9-ce63-45ad-bf11-05a9da03ef9f on hv-cinder-79338 Jul 19 09:26:11.412127 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-677188ee-20e6-427c-89b0-4f96de4b99b0 req-31f9e9da-6f64-4eb7-b660-7846fa5da885 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069727 Jul 19 09:26:11.413186 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 58/132] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:26:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:26:11.492386 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bfb2dcdc-202c-44a3-896e-d960ac18b337 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:11.493311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bfb2dcdc-202c-44a3-896e-d960ac18b337 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:11.506220 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bfb2dcdc-202c-44a3-896e-d960ac18b337 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:11.507231 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bfb2dcdc-202c-44a3-896e-d960ac18b337 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:11.508026 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bfb2dcdc-202c-44a3-896e-d960ac18b337 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:11.508465 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bfb2dcdc-202c-44a3-896e-d960ac18b337 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:11.636547 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bfb2dcdc-202c-44a3-896e-d960ac18b337 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 14 microversion: 2.1 time: 0.147731 Jul 19 09:26:11.637324 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 75/133] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:11 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:26:11.858821 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fa0ef1de-7960-4503-9de1-8662dfafd3c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:11.863833 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fa0ef1de-7960-4503-9de1-8662dfafd3c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:11.873454 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa0ef1de-7960-4503-9de1-8662dfafd3c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:11.874187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa0ef1de-7960-4503-9de1-8662dfafd3c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:11.879635 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa0ef1de-7960-4503-9de1-8662dfafd3c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:11.880601 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa0ef1de-7960-4503-9de1-8662dfafd3c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:12.018849 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fa0ef1de-7960-4503-9de1-8662dfafd3c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 14 microversion: 2.20 time: 0.165925 Jul 19 09:26:12.019621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 59/134] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:11 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:12.086819 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a8036106-26c2-4fed-abc8-8eab81d09619 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:12.087852 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a8036106-26c2-4fed-abc8-8eab81d09619 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:12.112037 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a8036106-26c2-4fed-abc8-8eab81d09619 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:12.112734 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a8036106-26c2-4fed-abc8-8eab81d09619 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:12.113692 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a8036106-26c2-4fed-abc8-8eab81d09619 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:12.116639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a8036106-26c2-4fed-abc8-8eab81d09619 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:12.164521 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-52492b86-68fd-4964-8784-85e8d7e6afb4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:12.166784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-52492b86-68fd-4964-8784-85e8d7e6afb4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:12.182899 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52492b86-68fd-4964-8784-85e8d7e6afb4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:12.183374 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52492b86-68fd-4964-8784-85e8d7e6afb4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:12.189829 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52492b86-68fd-4964-8784-85e8d7e6afb4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:12.190495 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52492b86-68fd-4964-8784-85e8d7e6afb4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:12.283744 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a8036106-26c2-4fed-abc8-8eab81d09619 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:12.293299 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a8036106-26c2-4fed-abc8-8eab81d09619 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.211454 Jul 19 09:26:12.293869 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 76/135] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:12 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:12.312400 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-52492b86-68fd-4964-8784-85e8d7e6afb4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:12.313165 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9d33d12d-45d8-48e6-81dc-05d31abd6d4c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:12.313534 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9d33d12d-45d8-48e6-81dc-05d31abd6d4c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:12.324749 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-52492b86-68fd-4964-8784-85e8d7e6afb4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1276 microversion: 2.1 time: 0.164858 Jul 19 09:26:12.326110 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 60/136] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:12 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:12.337567 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9d33d12d-45d8-48e6-81dc-05d31abd6d4c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:12.338609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9d33d12d-45d8-48e6-81dc-05d31abd6d4c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:12.339748 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9d33d12d-45d8-48e6-81dc-05d31abd6d4c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:12.340432 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9d33d12d-45d8-48e6-81dc-05d31abd6d4c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:12.392223 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9d33d12d-45d8-48e6-81dc-05d31abd6d4c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:12.393224 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9d33d12d-45d8-48e6-81dc-05d31abd6d4c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:12.393831 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.objects.instance [None req-9d33d12d-45d8-48e6-81dc-05d31abd6d4c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lazy-loading 'fault' on Instance uuid ba0814a9-ce63-45ad-bf11-05a9da03ef9f {{(pid=107463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:26:12.476064 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9d33d12d-45d8-48e6-81dc-05d31abd6d4c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f42ec475974a19bd9307d740e58e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08efcb8cc9a4d05b1fa155fbde3b042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:12.486468 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9d33d12d-45d8-48e6-81dc-05d31abd6d4c tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 200 len: 1350 microversion: 2.1 time: 0.191042 Jul 19 09:26:12.487091 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 77/137] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:12 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 1350 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:12.648343 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e039f85d-47be-418b-b370-1de8a447266b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:12.649722 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e039f85d-47be-418b-b370-1de8a447266b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:12.655719 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e039f85d-47be-418b-b370-1de8a447266b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:12.656165 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e039f85d-47be-418b-b370-1de8a447266b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:12.657007 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e039f85d-47be-418b-b370-1de8a447266b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:12.657617 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e039f85d-47be-418b-b370-1de8a447266b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:12.736161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e039f85d-47be-418b-b370-1de8a447266b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 14 microversion: 2.1 time: 0.091932 Jul 19 09:26:12.739417 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 61/138] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:12 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:26:13.029588 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a4b79f29-6849-414e-88f2-0e34516eab9e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:13.031174 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a4b79f29-6849-414e-88f2-0e34516eab9e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:13.037273 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4b79f29-6849-414e-88f2-0e34516eab9e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:13.038449 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4b79f29-6849-414e-88f2-0e34516eab9e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:13.039495 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4b79f29-6849-414e-88f2-0e34516eab9e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:13.040368 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4b79f29-6849-414e-88f2-0e34516eab9e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:13.126068 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a4b79f29-6849-414e-88f2-0e34516eab9e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 14 microversion: 2.20 time: 0.099443 Jul 19 09:26:13.126712 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 78/139] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:13 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:13.322445 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-13ccdfca-5188-4308-b615-7bdb5a8c7b8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:13.323306 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-13ccdfca-5188-4308-b615-7bdb5a8c7b8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:13.340197 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13ccdfca-5188-4308-b615-7bdb5a8c7b8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:13.340661 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13ccdfca-5188-4308-b615-7bdb5a8c7b8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:13.341444 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13ccdfca-5188-4308-b615-7bdb5a8c7b8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:13.341878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13ccdfca-5188-4308-b615-7bdb5a8c7b8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:13.343090 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-fdbe2285-8a78-41b8-af75-4334e95cce93 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:13.343782 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-fdbe2285-8a78-41b8-af75-4334e95cce93 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:13.351379 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fdbe2285-8a78-41b8-af75-4334e95cce93 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:13.353756 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fdbe2285-8a78-41b8-af75-4334e95cce93 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:13.354495 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fdbe2285-8a78-41b8-af75-4334e95cce93 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:13.354924 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fdbe2285-8a78-41b8-af75-4334e95cce93 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:13.620981 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-fdbe2285-8a78-41b8-af75-4334e95cce93 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:13.624087 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-13ccdfca-5188-4308-b615-7bdb5a8c7b8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:13.632124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-13ccdfca-5188-4308-b615-7bdb5a8c7b8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.322531 Jul 19 09:26:13.632716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 62/140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:13 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:26:13.646675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4ed6b802-5547-4cdd-88cd-8432791f44d3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:13.648229 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4ed6b802-5547-4cdd-88cd-8432791f44d3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:13.654447 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4ed6b802-5547-4cdd-88cd-8432791f44d3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:13.655177 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4ed6b802-5547-4cdd-88cd-8432791f44d3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:13.656105 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4ed6b802-5547-4cdd-88cd-8432791f44d3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:13.656225 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-fdbe2285-8a78-41b8-af75-4334e95cce93 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1318 microversion: 2.1 time: 0.316225 Jul 19 09:26:13.656794 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4ed6b802-5547-4cdd-88cd-8432791f44d3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:13.658715 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 79/141] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:13 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:26:13.681049 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-4ed6b802-5547-4cdd-88cd-8432791f44d3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] HTTP exception thrown: Instance ba0814a9-ce63-45ad-bf11-05a9da03ef9f could not be found. Jul 19 09:26:13.681651 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4ed6b802-5547-4cdd-88cd-8432791f44d3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Returning 404 to user: Instance ba0814a9-ce63-45ad-bf11-05a9da03ef9f could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:26:13.682498 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4ed6b802-5547-4cdd-88cd-8432791f44d3 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 404 len: 111 microversion: 2.1 time: 0.039900 Jul 19 09:26:13.683028 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 63/142] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:13 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:26:13.707682 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-5bcfa0d5-c09d-4e89-a8d9-b3ce81a3050e req-0ecbe3fe-0ea1-4d9d-a753-4ccca287ecfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c39f0be4-c55f-4e6c-bccf-be5be1e02919", "tag": "08717e43-af33-4b3c-b9f8-aaeffec6936b"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:13.710867 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:26:13.710867 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:26:13.724285 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-5bcfa0d5-c09d-4e89-a8d9-b3ce81a3050e req-0ecbe3fe-0ea1-4d9d-a753-4ccca287ecfe service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:13.724731 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-5bcfa0d5-c09d-4e89-a8d9-b3ce81a3050e req-0ecbe3fe-0ea1-4d9d-a753-4ccca287ecfe service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:13.746754 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5a13f7e9-c7dc-4574-9bbb-e14f5360f5bc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:13.747213 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-5bcfa0d5-c09d-4e89-a8d9-b3ce81a3050e req-0ecbe3fe-0ea1-4d9d-a753-4ccca287ecfe service nova] Creating event network-changed:08717e43-af33-4b3c-b9f8-aaeffec6936b for instance c39f0be4-c55f-4e6c-bccf-be5be1e02919 on hv-cinder-79338 Jul 19 09:26:13.747881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5a13f7e9-c7dc-4574-9bbb-e14f5360f5bc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:13.754302 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-5bcfa0d5-c09d-4e89-a8d9-b3ce81a3050e req-0ecbe3fe-0ea1-4d9d-a753-4ccca287ecfe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050866 Jul 19 09:26:13.755759 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 80/143] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:26:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:26:13.757299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5a13f7e9-c7dc-4574-9bbb-e14f5360f5bc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:13.757753 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5a13f7e9-c7dc-4574-9bbb-e14f5360f5bc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:13.758533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5a13f7e9-c7dc-4574-9bbb-e14f5360f5bc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:13.758971 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5a13f7e9-c7dc-4574-9bbb-e14f5360f5bc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:13.858128 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5a13f7e9-c7dc-4574-9bbb-e14f5360f5bc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 14 microversion: 2.1 time: 0.115199 Jul 19 09:26:13.859030 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 64/144] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:13 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 09:26:14.136525 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-dda0f74b-24ae-44d9-8945-0dfd0ebb2615 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:14.137518 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-dda0f74b-24ae-44d9-8945-0dfd0ebb2615 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:14.148819 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dda0f74b-24ae-44d9-8945-0dfd0ebb2615 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:14.149376 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dda0f74b-24ae-44d9-8945-0dfd0ebb2615 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:14.150956 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dda0f74b-24ae-44d9-8945-0dfd0ebb2615 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:14.152470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dda0f74b-24ae-44d9-8945-0dfd0ebb2615 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:14.241236 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-dda0f74b-24ae-44d9-8945-0dfd0ebb2615 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 14 microversion: 2.20 time: 0.108014 Jul 19 09:26:14.241975 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 81/145] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:14 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:14.649396 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e9e3467d-ab5e-44c4-80f4-445f5f27f85a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:14.650170 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e9e3467d-ab5e-44c4-80f4-445f5f27f85a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:14.657027 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e9e3467d-ab5e-44c4-80f4-445f5f27f85a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:14.657486 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e9e3467d-ab5e-44c4-80f4-445f5f27f85a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:14.658301 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e9e3467d-ab5e-44c4-80f4-445f5f27f85a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:14.658745 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e9e3467d-ab5e-44c4-80f4-445f5f27f85a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:14.676912 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b25e6528-bb49-4426-af8e-154655412e96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:14.680168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b25e6528-bb49-4426-af8e-154655412e96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:14.691110 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b25e6528-bb49-4426-af8e-154655412e96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:14.692497 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b25e6528-bb49-4426-af8e-154655412e96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:14.693660 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b25e6528-bb49-4426-af8e-154655412e96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:14.705493 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b25e6528-bb49-4426-af8e-154655412e96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:14.855750 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b25e6528-bb49-4426-af8e-154655412e96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:14.865178 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b25e6528-bb49-4426-af8e-154655412e96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1318 microversion: 2.1 time: 0.193129 Jul 19 09:26:14.866447 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 82/146] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:14 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:26:14.880602 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-11a5e9f6-2dfc-4725-a21c-3e87505b0422 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:14.881696 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-11a5e9f6-2dfc-4725-a21c-3e87505b0422 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:14.888757 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-11a5e9f6-2dfc-4725-a21c-3e87505b0422 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:14.889212 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-11a5e9f6-2dfc-4725-a21c-3e87505b0422 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:14.890156 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-11a5e9f6-2dfc-4725-a21c-3e87505b0422 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:14.890575 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-11a5e9f6-2dfc-4725-a21c-3e87505b0422 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:14.929928 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e9e3467d-ab5e-44c4-80f4-445f5f27f85a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:14.939295 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e9e3467d-ab5e-44c4-80f4-445f5f27f85a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.294210 Jul 19 09:26:14.940085 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 65/147] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:14 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:14.970357 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-11a5e9f6-2dfc-4725-a21c-3e87505b0422 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 14 microversion: 2.1 time: 0.101820 Jul 19 09:26:14.970994 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 83/148] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:14 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:26:15.086793 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-79857f25-9519-4352-a75e-7fa63cb1faa0 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:15.087324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-79857f25-9519-4352-a75e-7fa63cb1faa0 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:15.092998 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79857f25-9519-4352-a75e-7fa63cb1faa0 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:15.093448 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79857f25-9519-4352-a75e-7fa63cb1faa0 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:15.094219 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79857f25-9519-4352-a75e-7fa63cb1faa0 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:15.094660 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79857f25-9519-4352-a75e-7fa63cb1faa0 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:15.108413 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-79857f25-9519-4352-a75e-7fa63cb1faa0 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] HTTP exception thrown: Instance ba0814a9-ce63-45ad-bf11-05a9da03ef9f could not be found. Jul 19 09:26:15.109008 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-79857f25-9519-4352-a75e-7fa63cb1faa0 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Returning 404 to user: Instance ba0814a9-ce63-45ad-bf11-05a9da03ef9f could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:26:15.109904 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-79857f25-9519-4352-a75e-7fa63cb1faa0 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 404 len: 111 microversion: 2.1 time: 0.027393 Jul 19 09:26:15.110436 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 66/149] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:26:15 2021] DELETE /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:26:15.119471 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-26e697e6-8bb0-4833-a6b5-50d138824833 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:15.120171 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-26e697e6-8bb0-4833-a6b5-50d138824833 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] [instance: ba0814a9-ce63-45ad-bf11-05a9da03ef9f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:15.126535 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26e697e6-8bb0-4833-a6b5-50d138824833 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:15.126991 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26e697e6-8bb0-4833-a6b5-50d138824833 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:15.127810 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26e697e6-8bb0-4833-a6b5-50d138824833 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:15.128250 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26e697e6-8bb0-4833-a6b5-50d138824833 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:15.141463 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-26e697e6-8bb0-4833-a6b5-50d138824833 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] HTTP exception thrown: Instance ba0814a9-ce63-45ad-bf11-05a9da03ef9f could not be found. Jul 19 09:26:15.142696 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-26e697e6-8bb0-4833-a6b5-50d138824833 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] Returning 404 to user: Instance ba0814a9-ce63-45ad-bf11-05a9da03ef9f could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:26:15.143596 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-26e697e6-8bb0-4833-a6b5-50d138824833 tempest-DeleteServersTestJSON-407580336 tempest-DeleteServersTestJSON-407580336-project] 10.222.0.16 "GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f" status: 404 len: 111 microversion: 2.1 time: 0.028960 Jul 19 09:26:15.144136 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 84/150] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:15 2021] GET /compute/v2.1/servers/ba0814a9-ce63-45ad-bf11-05a9da03ef9f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:26:15.254397 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e73836a2-5fdb-4db6-bf1f-c882d723ee85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:15.255529 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e73836a2-5fdb-4db6-bf1f-c882d723ee85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:15.262429 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e73836a2-5fdb-4db6-bf1f-c882d723ee85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:15.263129 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e73836a2-5fdb-4db6-bf1f-c882d723ee85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:15.263982 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e73836a2-5fdb-4db6-bf1f-c882d723ee85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:15.264637 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e73836a2-5fdb-4db6-bf1f-c882d723ee85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:15.341642 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e73836a2-5fdb-4db6-bf1f-c882d723ee85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 14 microversion: 2.20 time: 0.092304 Jul 19 09:26:15.348688 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 67/151] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:15 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:15.883368 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c5b4fc28-0946-4155-a9d8-8e34bfddf8ac tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:15.884265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c5b4fc28-0946-4155-a9d8-8e34bfddf8ac tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:15.891312 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c5b4fc28-0946-4155-a9d8-8e34bfddf8ac tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:15.891961 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c5b4fc28-0946-4155-a9d8-8e34bfddf8ac tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:15.893208 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c5b4fc28-0946-4155-a9d8-8e34bfddf8ac tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:15.893935 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c5b4fc28-0946-4155-a9d8-8e34bfddf8ac tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:15.965731 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2f3a1533-b795-4540-933f-029208c676cc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:15.967556 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2f3a1533-b795-4540-933f-029208c676cc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:15.989044 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2f3a1533-b795-4540-933f-029208c676cc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:15.989526 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2f3a1533-b795-4540-933f-029208c676cc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:15.993869 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2f3a1533-b795-4540-933f-029208c676cc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:15.994384 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2f3a1533-b795-4540-933f-029208c676cc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:16.112147 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c5b4fc28-0946-4155-a9d8-8e34bfddf8ac tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:16.127851 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c5b4fc28-0946-4155-a9d8-8e34bfddf8ac tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1318 microversion: 2.1 time: 0.249518 Jul 19 09:26:16.128978 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 85/152] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:15 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:16.139865 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e2091567-4fbb-4116-9e55-628202ac3796 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:16.144580 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e2091567-4fbb-4116-9e55-628202ac3796 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:16.166600 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e2091567-4fbb-4116-9e55-628202ac3796 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:16.168828 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e2091567-4fbb-4116-9e55-628202ac3796 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:16.171133 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e2091567-4fbb-4116-9e55-628202ac3796 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:16.173448 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e2091567-4fbb-4116-9e55-628202ac3796 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:16.218784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2f3a1533-b795-4540-933f-029208c676cc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:16.226912 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2f3a1533-b795-4540-933f-029208c676cc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.274445 Jul 19 09:26:16.227509 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 68/153] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:15 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:16.256863 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e2091567-4fbb-4116-9e55-628202ac3796 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 14 microversion: 2.1 time: 0.125596 Jul 19 09:26:16.260539 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 86/154] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:16 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:26:16.356405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-034b681d-77da-442c-9758-6df39445226b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:16.358066 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-034b681d-77da-442c-9758-6df39445226b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:16.364578 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-034b681d-77da-442c-9758-6df39445226b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:16.365361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-034b681d-77da-442c-9758-6df39445226b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:16.367427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-034b681d-77da-442c-9758-6df39445226b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:16.368444 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-034b681d-77da-442c-9758-6df39445226b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:16.449154 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-034b681d-77da-442c-9758-6df39445226b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 14 microversion: 2.20 time: 0.097165 Jul 19 09:26:16.449845 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 69/155] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:16 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:17.146438 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-55c0e6d1-d3cd-43de-a537-22e37f378c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:17.147795 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-55c0e6d1-d3cd-43de-a537-22e37f378c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:17.154102 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-55c0e6d1-d3cd-43de-a537-22e37f378c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:17.154838 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-55c0e6d1-d3cd-43de-a537-22e37f378c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:17.155767 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-55c0e6d1-d3cd-43de-a537-22e37f378c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:17.156209 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-55c0e6d1-d3cd-43de-a537-22e37f378c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:17.245031 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-92e164b7-9237-45cc-af31-2d3d6bfd2512 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:17.246538 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-92e164b7-9237-45cc-af31-2d3d6bfd2512 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:17.256914 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-92e164b7-9237-45cc-af31-2d3d6bfd2512 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:17.257443 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-92e164b7-9237-45cc-af31-2d3d6bfd2512 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:17.258425 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-92e164b7-9237-45cc-af31-2d3d6bfd2512 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:17.259133 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-92e164b7-9237-45cc-af31-2d3d6bfd2512 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:17.360453 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-55c0e6d1-d3cd-43de-a537-22e37f378c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:17.374681 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-55c0e6d1-d3cd-43de-a537-22e37f378c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1318 microversion: 2.1 time: 0.232461 Jul 19 09:26:17.375771 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 87/156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:17 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:17.393483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bb003228-f65f-49b2-b215-7fb33b58fc5b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:17.395503 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bb003228-f65f-49b2-b215-7fb33b58fc5b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:17.404876 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb003228-f65f-49b2-b215-7fb33b58fc5b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:17.405404 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb003228-f65f-49b2-b215-7fb33b58fc5b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:17.406878 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb003228-f65f-49b2-b215-7fb33b58fc5b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:17.407714 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb003228-f65f-49b2-b215-7fb33b58fc5b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:17.476250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-92e164b7-9237-45cc-af31-2d3d6bfd2512 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:17.485039 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-92e164b7-9237-45cc-af31-2d3d6bfd2512 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.244991 Jul 19 09:26:17.485616 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 70/157] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:17 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:26:17.490513 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-352837f7-c068-408b-9c21-c18f48ed42f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:17.491727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-352837f7-c068-408b-9c21-c18f48ed42f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:17.497870 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-352837f7-c068-408b-9c21-c18f48ed42f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:17.498346 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-352837f7-c068-408b-9c21-c18f48ed42f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:17.499148 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-352837f7-c068-408b-9c21-c18f48ed42f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:17.499588 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-352837f7-c068-408b-9c21-c18f48ed42f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:18.579060 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bb003228-f65f-49b2-b215-7fb33b58fc5b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 14 microversion: 2.1 time: 1.201057 Jul 19 09:26:18.580178 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 88/158] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:17 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 14 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:26:18.745306 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1496663892", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452", "networks": [{"uuid": "ffe762f0-68bd-4db8-b328-c8e2b8fc1624"}]}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:18.802198 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.network.neutron [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] validate_networks() for [('ffe762f0-68bd-4db8-b328-c8e2b8fc1624', None, None, None)] {{(pid=107463) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:26:19.352502 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Flavor limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:26:19.352929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Image limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:26:19.353401 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Flavor pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:26:19.353814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Image pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:26:19.354249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:26:19.363626 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:19.364080 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:19.364873 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:19.365329 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:19.382096 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Getting quotas for project 4427b775629d442d9448281ff5171b24. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:26:19.385962 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Getting quotas for user 6b45b7dbaf5c41a998a64ef62132ea6d and project 4427b775629d442d9448281ff5171b24. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:26:19.398179 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Going to run 1 instances... {{(pid=107463) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:26:19.400775 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:26:19.450910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-75ca9366-cbae-47fa-81a5-485feae169ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.869180 Jul 19 09:26:19.451750 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 89/159] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 09:26:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 09:26:19.457226 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bbc3ef0d-70fe-404b-a814-008d975df744 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:19.458134 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bbc3ef0d-70fe-404b-a814-008d975df744 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:19.465784 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbc3ef0d-70fe-404b-a814-008d975df744 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:19.466257 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbc3ef0d-70fe-404b-a814-008d975df744 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:19.467455 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbc3ef0d-70fe-404b-a814-008d975df744 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:19.467899 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbc3ef0d-70fe-404b-a814-008d975df744 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:19.610204 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bbc3ef0d-70fe-404b-a814-008d975df744 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:19.618240 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bbc3ef0d-70fe-404b-a814-008d975df744 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1318 microversion: 2.1 time: 0.165518 Jul 19 09:26:19.618984 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 90/160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:19 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:19.623264 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7c64e446-2a99-4251-b545-c5b547e68f88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:19.623862 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7c64e446-2a99-4251-b545-c5b547e68f88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:19.629536 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7c64e446-2a99-4251-b545-c5b547e68f88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:19.630043 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7c64e446-2a99-4251-b545-c5b547e68f88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:19.630809 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7c64e446-2a99-4251-b545-c5b547e68f88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:19.631355 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7c64e446-2a99-4251-b545-c5b547e68f88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:19.772650 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7c64e446-2a99-4251-b545-c5b547e68f88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:19.780615 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7c64e446-2a99-4251-b545-c5b547e68f88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.160683 Jul 19 09:26:19.781378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 91/161] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:19 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:19.785918 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ec255e11-4ac9-469b-a399-7a51c6132745 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:19.786511 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ec255e11-4ac9-469b-a399-7a51c6132745 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:19.840083 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ec255e11-4ac9-469b-a399-7a51c6132745 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:19.846373 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ec255e11-4ac9-469b-a399-7a51c6132745 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 200 len: 1218 microversion: 2.1 time: 0.063768 Jul 19 09:26:19.846931 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 92/162] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:19 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:19.851270 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8ee7e2bb-637d-4862-8c5e-f1893eb9f7a0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:19.852211 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8ee7e2bb-637d-4862-8c5e-f1893eb9f7a0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:19.857525 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8ee7e2bb-637d-4862-8c5e-f1893eb9f7a0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:19.857961 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8ee7e2bb-637d-4862-8c5e-f1893eb9f7a0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:19.858709 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8ee7e2bb-637d-4862-8c5e-f1893eb9f7a0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:19.859172 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8ee7e2bb-637d-4862-8c5e-f1893eb9f7a0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:20.707894 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-352837f7-c068-408b-9c21-c18f48ed42f3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 14 microversion: 2.20 time: 3.220808 Jul 19 09:26:20.708516 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 71/163] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:17 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 14 bytes in 3222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:20.713239 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f9dadf23-83ca-4f13-a9b3-eb078bda2c96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:20.713939 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f9dadf23-83ca-4f13-a9b3-eb078bda2c96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:20.715338 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8ee7e2bb-637d-4862-8c5e-f1893eb9f7a0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 6451 microversion: 2.1 time: 0.866968 Jul 19 09:26:20.716061 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 93/164] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:19 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 6451 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:20.720593 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f9dadf23-83ca-4f13-a9b3-eb078bda2c96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:20.721042 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f9dadf23-83ca-4f13-a9b3-eb078bda2c96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:20.721821 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f9dadf23-83ca-4f13-a9b3-eb078bda2c96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:20.722256 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f9dadf23-83ca-4f13-a9b3-eb078bda2c96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:20.798197 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0a990b7e-4e10-4721-b63a-ff0038a720dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:20.799186 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0a990b7e-4e10-4721-b63a-ff0038a720dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:20.806584 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a990b7e-4e10-4721-b63a-ff0038a720dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:20.807053 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a990b7e-4e10-4721-b63a-ff0038a720dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:20.808069 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a990b7e-4e10-4721-b63a-ff0038a720dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:20.808702 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a990b7e-4e10-4721-b63a-ff0038a720dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:20.874071 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f9dadf23-83ca-4f13-a9b3-eb078bda2c96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:20.881804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f9dadf23-83ca-4f13-a9b3-eb078bda2c96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1318 microversion: 2.1 time: 0.172210 Jul 19 09:26:20.882373 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 72/165] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:20 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:20.887427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a4f35939-6d59-4714-8fb7-3bda7a62eeb5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:20.888109 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a4f35939-6d59-4714-8fb7-3bda7a62eeb5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:20.896072 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4f35939-6d59-4714-8fb7-3bda7a62eeb5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:20.897232 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4f35939-6d59-4714-8fb7-3bda7a62eeb5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:20.898755 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4f35939-6d59-4714-8fb7-3bda7a62eeb5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:20.899229 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4f35939-6d59-4714-8fb7-3bda7a62eeb5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:20.960919 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0a990b7e-4e10-4721-b63a-ff0038a720dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:20.965536 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a4f35939-6d59-4714-8fb7-3bda7a62eeb5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:20.968595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0a990b7e-4e10-4721-b63a-ff0038a720dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.174389 Jul 19 09:26:20.969173 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 94/166] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:20 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:26:20.972659 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a4f35939-6d59-4714-8fb7-3bda7a62eeb5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 200 len: 1270 microversion: 2.1 time: 0.089028 Jul 19 09:26:20.973210 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 73/167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:20 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:21.717749 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-172736bf-35cb-42f9-b455-22e4833e99de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:21.718671 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-172736bf-35cb-42f9-b455-22e4833e99de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:21.727402 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b7857955-8391-4a74-b108-ff4d520921ea tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:21.728505 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-172736bf-35cb-42f9-b455-22e4833e99de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:21.728867 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b7857955-8391-4a74-b108-ff4d520921ea tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:21.729549 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-172736bf-35cb-42f9-b455-22e4833e99de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:21.731298 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-172736bf-35cb-42f9-b455-22e4833e99de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:21.732139 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-172736bf-35cb-42f9-b455-22e4833e99de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:21.737511 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7857955-8391-4a74-b108-ff4d520921ea tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:21.737976 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7857955-8391-4a74-b108-ff4d520921ea tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:21.738757 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7857955-8391-4a74-b108-ff4d520921ea tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:21.739587 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7857955-8391-4a74-b108-ff4d520921ea tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:21.814111 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-172736bf-35cb-42f9-b455-22e4833e99de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 14 microversion: 2.20 time: 0.099768 Jul 19 09:26:21.814882 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 95/168] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:21 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:21.840243 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b7857955-8391-4a74-b108-ff4d520921ea tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 12027 microversion: 2.1 time: 0.117357 Jul 19 09:26:21.841103 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 74/169] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:21 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 12027 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:26:21.900460 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c1a4906a-e3ce-426a-b469-6351fdc81700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:21.901224 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c1a4906a-e3ce-426a-b469-6351fdc81700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:21.907992 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1a4906a-e3ce-426a-b469-6351fdc81700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:21.908450 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1a4906a-e3ce-426a-b469-6351fdc81700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:21.909224 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1a4906a-e3ce-426a-b469-6351fdc81700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:21.909832 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1a4906a-e3ce-426a-b469-6351fdc81700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:21.986919 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-98360080-dab1-4873-8d9c-b03479a58b97 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:21.987926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-98360080-dab1-4873-8d9c-b03479a58b97 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:22.002984 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98360080-dab1-4873-8d9c-b03479a58b97 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:22.007461 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98360080-dab1-4873-8d9c-b03479a58b97 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:22.007461 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98360080-dab1-4873-8d9c-b03479a58b97 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:22.007461 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98360080-dab1-4873-8d9c-b03479a58b97 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:22.074474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c1a4906a-e3ce-426a-b469-6351fdc81700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:22.083300 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c1a4906a-e3ce-426a-b469-6351fdc81700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1318 microversion: 2.1 time: 0.188302 Jul 19 09:26:22.096152 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 96/170] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:21 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:22.101330 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6cf3fc43-849b-4cba-91de-125b6c2e6991 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:22.101949 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6cf3fc43-849b-4cba-91de-125b6c2e6991 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:22.107778 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6cf3fc43-849b-4cba-91de-125b6c2e6991 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:22.108226 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6cf3fc43-849b-4cba-91de-125b6c2e6991 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:22.108996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6cf3fc43-849b-4cba-91de-125b6c2e6991 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:22.109432 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6cf3fc43-849b-4cba-91de-125b6c2e6991 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:22.202021 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-98360080-dab1-4873-8d9c-b03479a58b97 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:22.210037 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-98360080-dab1-4873-8d9c-b03479a58b97 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.227254 Jul 19 09:26:22.210604 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 75/171] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:21 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:26:22.251018 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6cf3fc43-849b-4cba-91de-125b6c2e6991 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:22.258657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6cf3fc43-849b-4cba-91de-125b6c2e6991 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 200 len: 1318 microversion: 2.1 time: 0.161277 Jul 19 09:26:22.259239 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 97/172] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:22 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:22.825057 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-204c0eaa-6339-4baa-8006-5eb894df896d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:22.825964 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-204c0eaa-6339-4baa-8006-5eb894df896d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:22.831758 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-204c0eaa-6339-4baa-8006-5eb894df896d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:22.832205 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-204c0eaa-6339-4baa-8006-5eb894df896d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:22.832963 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-204c0eaa-6339-4baa-8006-5eb894df896d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:22.833395 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-204c0eaa-6339-4baa-8006-5eb894df896d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:22.851278 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-113b1bcb-d961-4356-a133-63a8d7c0bd75 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:22.852268 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-113b1bcb-d961-4356-a133-63a8d7c0bd75 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:22.858529 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-113b1bcb-d961-4356-a133-63a8d7c0bd75 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:22.858529 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-113b1bcb-d961-4356-a133-63a8d7c0bd75 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:22.859208 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-113b1bcb-d961-4356-a133-63a8d7c0bd75 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:22.859641 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-113b1bcb-d961-4356-a133-63a8d7c0bd75 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:25.106784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-204c0eaa-6339-4baa-8006-5eb894df896d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 14 microversion: 2.20 time: 2.285378 Jul 19 09:26:25.107375 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-113b1bcb-d961-4356-a133-63a8d7c0bd75 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 17598 microversion: 2.1 time: 2.259572 Jul 19 09:26:25.107835 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 76/173] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:22 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 14 bytes in 2287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:25.111078 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 98/174] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:22 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 17598 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:26:25.112802 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9952f1bf-f894-46c1-8a62-4d972ce1c990 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:25.113535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9952f1bf-f894-46c1-8a62-4d972ce1c990 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:25.113707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-19496e0e-1f83-4d15-8bd9-eff09b16faf7 req-8628636a-93ed-407f-b30c-478ecc749550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39f0be4-c55f-4e6c-bccf-be5be1e02919", "name": "network-vif-plugged", "status": "completed", "tag": "08717e43-af33-4b3c-b9f8-aaeffec6936b"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:25.115782 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:26:25.115782 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:26:25.120753 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9952f1bf-f894-46c1-8a62-4d972ce1c990 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:25.121197 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9952f1bf-f894-46c1-8a62-4d972ce1c990 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:25.121976 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9952f1bf-f894-46c1-8a62-4d972ce1c990 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:25.122409 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9952f1bf-f894-46c1-8a62-4d972ce1c990 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:25.123616 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-19496e0e-1f83-4d15-8bd9-eff09b16faf7 req-8628636a-93ed-407f-b30c-478ecc749550 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:25.124067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-19496e0e-1f83-4d15-8bd9-eff09b16faf7 req-8628636a-93ed-407f-b30c-478ecc749550 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:25.136636 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-19496e0e-1f83-4d15-8bd9-eff09b16faf7 req-8628636a-93ed-407f-b30c-478ecc749550 service nova] Creating event network-vif-plugged:08717e43-af33-4b3c-b9f8-aaeffec6936b for instance c39f0be4-c55f-4e6c-bccf-be5be1e02919 on hv-cinder-79338 Jul 19 09:26:25.143615 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-19496e0e-1f83-4d15-8bd9-eff09b16faf7 req-8628636a-93ed-407f-b30c-478ecc749550 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033366 Jul 19 09:26:25.144467 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 99/175] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:26:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:26:25.149919 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-053e0de7-00c3-4f92-a0cd-edcc993a32c5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:25.150609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-053e0de7-00c3-4f92-a0cd-edcc993a32c5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:25.158829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-053e0de7-00c3-4f92-a0cd-edcc993a32c5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:25.159258 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-053e0de7-00c3-4f92-a0cd-edcc993a32c5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:25.160032 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-053e0de7-00c3-4f92-a0cd-edcc993a32c5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:25.161090 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-053e0de7-00c3-4f92-a0cd-edcc993a32c5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:25.316271 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-053e0de7-00c3-4f92-a0cd-edcc993a32c5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:25.326637 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-053e0de7-00c3-4f92-a0cd-edcc993a32c5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.180920 Jul 19 09:26:25.327254 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 100/176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:25 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:25.332141 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f9970afd-8b48-43e1-86bb-1e0e8f5d9a91 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:25.332997 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f9970afd-8b48-43e1-86bb-1e0e8f5d9a91 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:25.340471 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9970afd-8b48-43e1-86bb-1e0e8f5d9a91 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:25.340928 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9970afd-8b48-43e1-86bb-1e0e8f5d9a91 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:25.341714 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9970afd-8b48-43e1-86bb-1e0e8f5d9a91 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:25.342147 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9970afd-8b48-43e1-86bb-1e0e8f5d9a91 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:25.419485 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9952f1bf-f894-46c1-8a62-4d972ce1c990 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:25.433142 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9952f1bf-f894-46c1-8a62-4d972ce1c990 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1318 microversion: 2.1 time: 0.323582 Jul 19 09:26:25.442636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 77/177] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:25 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:25.442636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-47dd71de-5172-481e-ba43-5d6b15d2b5b5 req-b55f35bc-f547-46da-9154-8840971d8e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f", "tag": "420353fa-94ca-4654-bcb8-98ba2b387c58"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:25.442636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:26:25.442636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:26:25.449987 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-47dd71de-5172-481e-ba43-5d6b15d2b5b5 req-b55f35bc-f547-46da-9154-8840971d8e50 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:25.451100 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-47dd71de-5172-481e-ba43-5d6b15d2b5b5 req-b55f35bc-f547-46da-9154-8840971d8e50 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:25.466514 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-47dd71de-5172-481e-ba43-5d6b15d2b5b5 req-b55f35bc-f547-46da-9154-8840971d8e50 service nova] Creating event network-changed:420353fa-94ca-4654-bcb8-98ba2b387c58 for instance d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f on hv-cinder-79338 Jul 19 09:26:25.471898 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-47dd71de-5172-481e-ba43-5d6b15d2b5b5 req-b55f35bc-f547-46da-9154-8840971d8e50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036726 Jul 19 09:26:25.472727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 78/178] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:26:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:26:25.483363 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f9970afd-8b48-43e1-86bb-1e0e8f5d9a91 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:25.491595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f9970afd-8b48-43e1-86bb-1e0e8f5d9a91 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 200 len: 1318 microversion: 2.1 time: 0.163122 Jul 19 09:26:25.492251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 101/179] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:25 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:26.118292 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d78dc9ac-7b2e-4f67-872a-2cddd47a84fe tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:26.118983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-39a178b2-6e64-4205-b8f3-6da0fcdb35e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:26.119533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d78dc9ac-7b2e-4f67-872a-2cddd47a84fe tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:26.120202 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-39a178b2-6e64-4205-b8f3-6da0fcdb35e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:26.127063 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39a178b2-6e64-4205-b8f3-6da0fcdb35e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:26.127274 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d78dc9ac-7b2e-4f67-872a-2cddd47a84fe tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:26.127650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d78dc9ac-7b2e-4f67-872a-2cddd47a84fe tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:26.127909 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39a178b2-6e64-4205-b8f3-6da0fcdb35e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:26.128734 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39a178b2-6e64-4205-b8f3-6da0fcdb35e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:26.129324 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39a178b2-6e64-4205-b8f3-6da0fcdb35e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:26.129429 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d78dc9ac-7b2e-4f67-872a-2cddd47a84fe tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:26.129947 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d78dc9ac-7b2e-4f67-872a-2cddd47a84fe tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:29.612156 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-39a178b2-6e64-4205-b8f3-6da0fcdb35e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 3903 microversion: 2.20 time: 3.497705 Jul 19 09:26:29.613530 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 102/180] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:26 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 3903 bytes in 3499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:26:29.617529 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b1797530-4bb6-4fb6-a9e0-282dba7bb77b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:29.618211 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b1797530-4bb6-4fb6-a9e0-282dba7bb77b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:29.625310 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b1797530-4bb6-4fb6-a9e0-282dba7bb77b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:29.625760 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b1797530-4bb6-4fb6-a9e0-282dba7bb77b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:29.626585 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b1797530-4bb6-4fb6-a9e0-282dba7bb77b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:29.627029 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b1797530-4bb6-4fb6-a9e0-282dba7bb77b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:29.636773 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d78dc9ac-7b2e-4f67-872a-2cddd47a84fe tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 23800 microversion: 2.1 time: 3.522244 Jul 19 09:26:29.644517 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 79/181] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:26 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 23800 bytes in 3531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:26:29.650937 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b92b0690-1430-4ccd-a8d1-f75e9f380f2b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:29.651976 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b92b0690-1430-4ccd-a8d1-f75e9f380f2b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:29.658895 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b92b0690-1430-4ccd-a8d1-f75e9f380f2b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:29.659647 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b92b0690-1430-4ccd-a8d1-f75e9f380f2b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:29.660811 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b92b0690-1430-4ccd-a8d1-f75e9f380f2b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:29.661428 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b92b0690-1430-4ccd-a8d1-f75e9f380f2b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:29.779679 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b1797530-4bb6-4fb6-a9e0-282dba7bb77b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:29.788471 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b1797530-4bb6-4fb6-a9e0-282dba7bb77b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.174523 Jul 19 09:26:29.791415 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 103/182] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:29 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:29.797589 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f9ca2ad5-59e5-4fdb-87b2-44383eb2d0a5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:29.798466 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f9ca2ad5-59e5-4fdb-87b2-44383eb2d0a5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:29.805582 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9ca2ad5-59e5-4fdb-87b2-44383eb2d0a5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:29.806209 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9ca2ad5-59e5-4fdb-87b2-44383eb2d0a5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:29.807024 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9ca2ad5-59e5-4fdb-87b2-44383eb2d0a5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:29.807419 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9ca2ad5-59e5-4fdb-87b2-44383eb2d0a5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:29.883910 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b92b0690-1430-4ccd-a8d1-f75e9f380f2b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:29.891266 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b92b0690-1430-4ccd-a8d1-f75e9f380f2b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1318 microversion: 2.1 time: 0.245120 Jul 19 09:26:29.892061 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 80/183] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:29 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:29.959674 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f9ca2ad5-59e5-4fdb-87b2-44383eb2d0a5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:29.967386 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f9ca2ad5-59e5-4fdb-87b2-44383eb2d0a5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 200 len: 1318 microversion: 2.1 time: 0.174290 Jul 19 09:26:29.967971 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 104/184] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:29 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:30.623205 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cf0c5bac-3b1c-414e-bac8-cf849962c0cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:30.624144 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cf0c5bac-3b1c-414e-bac8-cf849962c0cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:30.630099 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cf0c5bac-3b1c-414e-bac8-cf849962c0cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:30.631135 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cf0c5bac-3b1c-414e-bac8-cf849962c0cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:30.632317 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cf0c5bac-3b1c-414e-bac8-cf849962c0cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:30.632752 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cf0c5bac-3b1c-414e-bac8-cf849962c0cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:30.652770 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b639c1bb-b0f7-47f6-b58b-14b4db8b73b5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:30.653790 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b639c1bb-b0f7-47f6-b58b-14b4db8b73b5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:30.660401 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b639c1bb-b0f7-47f6-b58b-14b4db8b73b5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:30.660854 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b639c1bb-b0f7-47f6-b58b-14b4db8b73b5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:30.661657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b639c1bb-b0f7-47f6-b58b-14b4db8b73b5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:30.662632 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b639c1bb-b0f7-47f6-b58b-14b4db8b73b5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:30.710286 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cf0c5bac-3b1c-414e-bac8-cf849962c0cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 15064 microversion: 2.20 time: 0.090658 Jul 19 09:26:30.710861 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 81/185] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:30 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 15064 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:26:30.753252 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b639c1bb-b0f7-47f6-b58b-14b4db8b73b5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 24512 microversion: 2.1 time: 0.104144 Jul 19 09:26:30.754068 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 105/186] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:30 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 24512 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:26:30.810567 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ec80f98c-47ea-4572-a4f1-f8ec9953782b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:30.811290 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ec80f98c-47ea-4572-a4f1-f8ec9953782b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:30.817589 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec80f98c-47ea-4572-a4f1-f8ec9953782b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:30.818060 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec80f98c-47ea-4572-a4f1-f8ec9953782b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:30.818824 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec80f98c-47ea-4572-a4f1-f8ec9953782b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:30.819297 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec80f98c-47ea-4572-a4f1-f8ec9953782b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:30.909416 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-27e5c723-0849-4128-b1c2-9f541e0fb264 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:30.910921 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-27e5c723-0849-4128-b1c2-9f541e0fb264 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:30.919463 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-27e5c723-0849-4128-b1c2-9f541e0fb264 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:30.919849 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-27e5c723-0849-4128-b1c2-9f541e0fb264 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:30.920616 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-27e5c723-0849-4128-b1c2-9f541e0fb264 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:30.921043 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-27e5c723-0849-4128-b1c2-9f541e0fb264 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:30.997842 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ec80f98c-47ea-4572-a4f1-f8ec9953782b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:31.015151 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ec80f98c-47ea-4572-a4f1-f8ec9953782b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.209205 Jul 19 09:26:31.015845 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 82/187] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:30 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:31.020553 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9292b3d5-8928-4627-86a2-547a8c0658e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:31.021838 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9292b3d5-8928-4627-86a2-547a8c0658e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:31.028862 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9292b3d5-8928-4627-86a2-547a8c0658e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:31.030256 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9292b3d5-8928-4627-86a2-547a8c0658e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:31.031441 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9292b3d5-8928-4627-86a2-547a8c0658e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:31.032080 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9292b3d5-8928-4627-86a2-547a8c0658e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:31.087527 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-27e5c723-0849-4128-b1c2-9f541e0fb264 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:31.096747 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-27e5c723-0849-4128-b1c2-9f541e0fb264 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1507 microversion: 2.1 time: 0.191890 Jul 19 09:26:31.097313 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 106/188] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:30 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:31.218907 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9292b3d5-8928-4627-86a2-547a8c0658e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:31.228848 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9292b3d5-8928-4627-86a2-547a8c0658e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 200 len: 1318 microversion: 2.1 time: 0.211637 Jul 19 09:26:31.229518 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 83/189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:31 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:31.724269 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-08d26df0-db8f-4e76-9e1b-7d1ff7c367b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:31.728988 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-08d26df0-db8f-4e76-9e1b-7d1ff7c367b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:31.735903 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-08d26df0-db8f-4e76-9e1b-7d1ff7c367b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:31.736533 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-08d26df0-db8f-4e76-9e1b-7d1ff7c367b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:31.737521 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-08d26df0-db8f-4e76-9e1b-7d1ff7c367b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:31.737946 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-08d26df0-db8f-4e76-9e1b-7d1ff7c367b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:31.764863 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9e585fb0-87a0-4a0c-97c8-03a1f1ed4b6d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:31.766698 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9e585fb0-87a0-4a0c-97c8-03a1f1ed4b6d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:31.778348 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9e585fb0-87a0-4a0c-97c8-03a1f1ed4b6d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:31.779367 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9e585fb0-87a0-4a0c-97c8-03a1f1ed4b6d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:31.780372 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9e585fb0-87a0-4a0c-97c8-03a1f1ed4b6d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:31.780998 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9e585fb0-87a0-4a0c-97c8-03a1f1ed4b6d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:31.811246 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-08d26df0-db8f-4e76-9e1b-7d1ff7c367b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 17861 microversion: 2.20 time: 0.090636 Jul 19 09:26:31.812494 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 107/190] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:31 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 17861 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:26:31.874747 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9e585fb0-87a0-4a0c-97c8-03a1f1ed4b6d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 25151 microversion: 2.1 time: 0.113250 Jul 19 09:26:31.879135 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 84/191] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:31 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 25151 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:26:32.034421 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6c374910-e197-4093-8cd9-a3a8d36a5d98 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:32.035440 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6c374910-e197-4093-8cd9-a3a8d36a5d98 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:32.042364 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c374910-e197-4093-8cd9-a3a8d36a5d98 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:32.042812 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c374910-e197-4093-8cd9-a3a8d36a5d98 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:32.043629 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c374910-e197-4093-8cd9-a3a8d36a5d98 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:32.044059 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c374910-e197-4093-8cd9-a3a8d36a5d98 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:32.197334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6c374910-e197-4093-8cd9-a3a8d36a5d98 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:32.205389 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6c374910-e197-4093-8cd9-a3a8d36a5d98 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.175522 Jul 19 09:26:32.205963 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 108/192] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:32 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:32.246888 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-087b00d6-9e1e-41f7-8aaa-79034059d9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:32.247649 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-087b00d6-9e1e-41f7-8aaa-79034059d9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:32.253803 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-087b00d6-9e1e-41f7-8aaa-79034059d9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:32.254250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-087b00d6-9e1e-41f7-8aaa-79034059d9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:32.255016 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-087b00d6-9e1e-41f7-8aaa-79034059d9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:32.255508 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-087b00d6-9e1e-41f7-8aaa-79034059d9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:32.405261 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-087b00d6-9e1e-41f7-8aaa-79034059d9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:32.413580 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-087b00d6-9e1e-41f7-8aaa-79034059d9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 200 len: 1318 microversion: 2.1 time: 0.171140 Jul 19 09:26:32.414240 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 85/193] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:32 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:32.823225 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3ffc86de-e415-4ddb-9f5d-fbf1c38fd4f0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:32.824126 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3ffc86de-e415-4ddb-9f5d-fbf1c38fd4f0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:32.831806 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3ffc86de-e415-4ddb-9f5d-fbf1c38fd4f0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:32.832246 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3ffc86de-e415-4ddb-9f5d-fbf1c38fd4f0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:32.833007 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3ffc86de-e415-4ddb-9f5d-fbf1c38fd4f0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:32.833433 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3ffc86de-e415-4ddb-9f5d-fbf1c38fd4f0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:32.889989 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5c32a9ed-c716-4420-aafb-c7d5b7cc3a49 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:32.890961 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5c32a9ed-c716-4420-aafb-c7d5b7cc3a49 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:32.899256 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c32a9ed-c716-4420-aafb-c7d5b7cc3a49 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:32.899841 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c32a9ed-c716-4420-aafb-c7d5b7cc3a49 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:32.900713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c32a9ed-c716-4420-aafb-c7d5b7cc3a49 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:32.901385 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c32a9ed-c716-4420-aafb-c7d5b7cc3a49 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:32.914145 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3ffc86de-e415-4ddb-9f5d-fbf1c38fd4f0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 18561 microversion: 2.20 time: 0.094652 Jul 19 09:26:32.918136 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 109/194] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:32 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 18561 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:26:32.977634 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5c32a9ed-c716-4420-aafb-c7d5b7cc3a49 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 26047 microversion: 2.1 time: 0.092790 Jul 19 09:26:32.978360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 86/195] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:32 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 26047 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:26:33.222101 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a461f868-266c-44d0-baf6-79bb21878499 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:33.222824 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a461f868-266c-44d0-baf6-79bb21878499 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:33.229228 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a461f868-266c-44d0-baf6-79bb21878499 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:33.229879 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a461f868-266c-44d0-baf6-79bb21878499 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:33.230979 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a461f868-266c-44d0-baf6-79bb21878499 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:33.231543 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a461f868-266c-44d0-baf6-79bb21878499 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:33.379272 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a461f868-266c-44d0-baf6-79bb21878499 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:33.387418 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a461f868-266c-44d0-baf6-79bb21878499 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.169353 Jul 19 09:26:33.388068 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 110/196] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:33 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:33.430667 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b84029fa-34bd-4cd5-906c-2b9c34f22aaa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:33.431408 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b84029fa-34bd-4cd5-906c-2b9c34f22aaa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:33.438489 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b84029fa-34bd-4cd5-906c-2b9c34f22aaa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:33.439161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b84029fa-34bd-4cd5-906c-2b9c34f22aaa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:33.439926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b84029fa-34bd-4cd5-906c-2b9c34f22aaa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:33.440537 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b84029fa-34bd-4cd5-906c-2b9c34f22aaa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:33.584171 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b84029fa-34bd-4cd5-906c-2b9c34f22aaa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:33.591891 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b84029fa-34bd-4cd5-906c-2b9c34f22aaa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 200 len: 1318 microversion: 2.1 time: 0.165993 Jul 19 09:26:33.592533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 87/197] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:33 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:33.925595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-be33044f-389f-41a2-8074-266dbe24ad4c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:33.926498 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-be33044f-389f-41a2-8074-266dbe24ad4c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:33.932147 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-be33044f-389f-41a2-8074-266dbe24ad4c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:33.932586 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-be33044f-389f-41a2-8074-266dbe24ad4c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:33.933337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-be33044f-389f-41a2-8074-266dbe24ad4c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:33.933765 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-be33044f-389f-41a2-8074-266dbe24ad4c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:33.988940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a02166b9-0a4d-4d3b-b44f-a158b83dc2ac tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:33.990483 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a02166b9-0a4d-4d3b-b44f-a158b83dc2ac tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:33.996532 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a02166b9-0a4d-4d3b-b44f-a158b83dc2ac tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:33.997150 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a02166b9-0a4d-4d3b-b44f-a158b83dc2ac tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:33.998105 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a02166b9-0a4d-4d3b-b44f-a158b83dc2ac tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:33.998537 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a02166b9-0a4d-4d3b-b44f-a158b83dc2ac tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:36.213441 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-be33044f-389f-41a2-8074-266dbe24ad4c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 22990 microversion: 2.20 time: 2.286916 Jul 19 09:26:36.217001 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a02166b9-0a4d-4d3b-b44f-a158b83dc2ac tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 27347 microversion: 2.1 time: 2.231473 Jul 19 09:26:36.221139 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 88/198] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:33 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 27347 bytes in 2233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:26:36.221283 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 111/199] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:33 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 22990 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:26:36.222549 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2011f4a4-d744-4c00-aea3-caf32153ae84 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:36.223434 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2011f4a4-d744-4c00-aea3-caf32153ae84 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:36.225887 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-665a67a0-ab56-4155-a5ad-68d7f5f5617f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:36.229783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-665a67a0-ab56-4155-a5ad-68d7f5f5617f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:36.230257 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2011f4a4-d744-4c00-aea3-caf32153ae84 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:36.231086 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2011f4a4-d744-4c00-aea3-caf32153ae84 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:36.232045 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2011f4a4-d744-4c00-aea3-caf32153ae84 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:36.232634 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2011f4a4-d744-4c00-aea3-caf32153ae84 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:36.236852 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-665a67a0-ab56-4155-a5ad-68d7f5f5617f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:36.237217 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-665a67a0-ab56-4155-a5ad-68d7f5f5617f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:36.238273 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-665a67a0-ab56-4155-a5ad-68d7f5f5617f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:36.238985 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-665a67a0-ab56-4155-a5ad-68d7f5f5617f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:36.398050 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2011f4a4-d744-4c00-aea3-caf32153ae84 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:36.402843 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-665a67a0-ab56-4155-a5ad-68d7f5f5617f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:36.405686 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2011f4a4-d744-4c00-aea3-caf32153ae84 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.186758 Jul 19 09:26:36.406260 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 89/200] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:36 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:36.412477 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-665a67a0-ab56-4155-a5ad-68d7f5f5617f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 200 len: 1318 microversion: 2.1 time: 0.190992 Jul 19 09:26:36.413359 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 112/201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:36 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:37.229490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1c4ff408-33f1-406a-ab11-ad5c8ed103e3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:37.230561 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1c4ff408-33f1-406a-ab11-ad5c8ed103e3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:37.231634 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c733bb79-30b2-45c6-8509-c22e2ad673e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:37.232909 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c733bb79-30b2-45c6-8509-c22e2ad673e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:37.237892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c4ff408-33f1-406a-ab11-ad5c8ed103e3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:37.238318 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c4ff408-33f1-406a-ab11-ad5c8ed103e3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:37.239585 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c4ff408-33f1-406a-ab11-ad5c8ed103e3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:37.240464 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c4ff408-33f1-406a-ab11-ad5c8ed103e3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:37.248225 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c733bb79-30b2-45c6-8509-c22e2ad673e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:37.248896 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c733bb79-30b2-45c6-8509-c22e2ad673e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:37.249838 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c733bb79-30b2-45c6-8509-c22e2ad673e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:37.250434 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c733bb79-30b2-45c6-8509-c22e2ad673e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:37.326530 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1c4ff408-33f1-406a-ab11-ad5c8ed103e3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 27513 microversion: 2.1 time: 0.100684 Jul 19 09:26:37.328410 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 90/202] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:37 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 27513 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:26:37.331623 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c733bb79-30b2-45c6-8509-c22e2ad673e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 23806 microversion: 2.20 time: 0.103301 Jul 19 09:26:37.332357 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 113/203] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:37 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 23806 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:26:37.423725 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-eb3f0a43-3eae-4394-ae5f-8344bc1750af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:37.424740 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-eb3f0a43-3eae-4394-ae5f-8344bc1750af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:37.430928 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-57adb009-74d8-4291-b7d1-474cc91828a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:37.431901 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-57adb009-74d8-4291-b7d1-474cc91828a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:37.432488 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eb3f0a43-3eae-4394-ae5f-8344bc1750af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:37.432946 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eb3f0a43-3eae-4394-ae5f-8344bc1750af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:37.434048 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eb3f0a43-3eae-4394-ae5f-8344bc1750af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:37.434482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eb3f0a43-3eae-4394-ae5f-8344bc1750af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:37.438737 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-57adb009-74d8-4291-b7d1-474cc91828a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:37.439311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-57adb009-74d8-4291-b7d1-474cc91828a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:37.440243 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-57adb009-74d8-4291-b7d1-474cc91828a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:37.440749 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-57adb009-74d8-4291-b7d1-474cc91828a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:37.577637 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-eb3f0a43-3eae-4394-ae5f-8344bc1750af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:37.583845 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-57adb009-74d8-4291-b7d1-474cc91828a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:37.586101 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-eb3f0a43-3eae-4394-ae5f-8344bc1750af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.165834 Jul 19 09:26:37.595163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 91/204] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:37 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:37.600906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-57adb009-74d8-4291-b7d1-474cc91828a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 200 len: 1318 microversion: 2.1 time: 0.174725 Jul 19 09:26:37.601475 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 114/205] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:37 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:26:38.340506 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d6266a4a-c2e5-4322-bdcc-5e71953ec3da tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:38.341986 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d6266a4a-c2e5-4322-bdcc-5e71953ec3da tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:38.345322 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c0a10fc5-615d-4d38-b755-d5504ec915ca tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:38.346692 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c0a10fc5-615d-4d38-b755-d5504ec915ca tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:38.348046 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d6266a4a-c2e5-4322-bdcc-5e71953ec3da tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:38.348507 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d6266a4a-c2e5-4322-bdcc-5e71953ec3da tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:38.349325 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d6266a4a-c2e5-4322-bdcc-5e71953ec3da tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:38.349758 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d6266a4a-c2e5-4322-bdcc-5e71953ec3da tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:38.352837 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c0a10fc5-615d-4d38-b755-d5504ec915ca tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:38.353286 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c0a10fc5-615d-4d38-b755-d5504ec915ca tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:38.354214 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c0a10fc5-615d-4d38-b755-d5504ec915ca tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:38.354793 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c0a10fc5-615d-4d38-b755-d5504ec915ca tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:38.436668 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d6266a4a-c2e5-4322-bdcc-5e71953ec3da tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 27623 microversion: 2.1 time: 0.101094 Jul 19 09:26:38.441434 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 92/206] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:38 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 27623 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:26:38.450712 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c0a10fc5-615d-4d38-b755-d5504ec915ca tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 24697 microversion: 2.20 time: 0.110142 Jul 19 09:26:38.451887 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 115/207] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:38 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 24697 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:26:38.532646 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-bb1299de-2110-4f3d-ac19-369beb732c9f req-04d364cc-8142-472b-93aa-678977d0eb95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f", "name": "network-vif-plugged", "status": "completed", "tag": "420353fa-94ca-4654-bcb8-98ba2b387c58"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:38.534163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:26:38.534163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:26:38.541072 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-bb1299de-2110-4f3d-ac19-369beb732c9f req-04d364cc-8142-472b-93aa-678977d0eb95 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:38.541512 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-bb1299de-2110-4f3d-ac19-369beb732c9f req-04d364cc-8142-472b-93aa-678977d0eb95 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:38.553246 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-bb1299de-2110-4f3d-ac19-369beb732c9f req-04d364cc-8142-472b-93aa-678977d0eb95 service nova] Creating event network-vif-plugged:420353fa-94ca-4654-bcb8-98ba2b387c58 for instance d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f on hv-cinder-79338 Jul 19 09:26:38.565865 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-bb1299de-2110-4f3d-ac19-369beb732c9f req-04d364cc-8142-472b-93aa-678977d0eb95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037636 Jul 19 09:26:38.566511 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 93/208] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:26:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:26:38.603006 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cdac3519-b7f3-4ad8-8d2f-336ce568de8c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:38.603741 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-cdac3519-b7f3-4ad8-8d2f-336ce568de8c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:38.610135 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdac3519-b7f3-4ad8-8d2f-336ce568de8c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:38.610581 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdac3519-b7f3-4ad8-8d2f-336ce568de8c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:38.611402 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdac3519-b7f3-4ad8-8d2f-336ce568de8c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:38.611835 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdac3519-b7f3-4ad8-8d2f-336ce568de8c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:38.618093 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fbd8120c-3945-4383-8c85-ea9b6e56a206 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:38.618783 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fbd8120c-3945-4383-8c85-ea9b6e56a206 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:38.624727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fbd8120c-3945-4383-8c85-ea9b6e56a206 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:38.625167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fbd8120c-3945-4383-8c85-ea9b6e56a206 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:38.625922 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fbd8120c-3945-4383-8c85-ea9b6e56a206 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:38.626356 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fbd8120c-3945-4383-8c85-ea9b6e56a206 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:38.758885 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cdac3519-b7f3-4ad8-8d2f-336ce568de8c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:38.766427 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-cdac3519-b7f3-4ad8-8d2f-336ce568de8c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.167381 Jul 19 09:26:38.767009 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 116/209] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:38 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:38.807878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fbd8120c-3945-4383-8c85-ea9b6e56a206 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:38.815317 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fbd8120c-3945-4383-8c85-ea9b6e56a206 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 200 len: 1318 microversion: 2.1 time: 0.201639 Jul 19 09:26:38.816016 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 94/210] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:38 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:26:39.447563 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ebdd0958-648e-4dfc-ad48-19e0aa8be930 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:39.448485 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ebdd0958-648e-4dfc-ad48-19e0aa8be930 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:39.454230 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ebdd0958-648e-4dfc-ad48-19e0aa8be930 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:39.454679 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ebdd0958-648e-4dfc-ad48-19e0aa8be930 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:39.455470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ebdd0958-648e-4dfc-ad48-19e0aa8be930 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:39.457705 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ebdd0958-648e-4dfc-ad48-19e0aa8be930 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:39.463515 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3d63e5ff-a56f-42d8-87ea-2fd85a0c53c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:39.464718 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3d63e5ff-a56f-42d8-87ea-2fd85a0c53c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:39.470843 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3d63e5ff-a56f-42d8-87ea-2fd85a0c53c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:39.471590 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3d63e5ff-a56f-42d8-87ea-2fd85a0c53c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:39.472475 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3d63e5ff-a56f-42d8-87ea-2fd85a0c53c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:39.473038 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3d63e5ff-a56f-42d8-87ea-2fd85a0c53c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:39.566859 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ebdd0958-648e-4dfc-ad48-19e0aa8be930 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 27886 microversion: 2.1 time: 0.122855 Jul 19 09:26:39.567216 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3d63e5ff-a56f-42d8-87ea-2fd85a0c53c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 25322 microversion: 2.20 time: 0.107073 Jul 19 09:26:39.570979 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 117/211] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:39 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 27886 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:26:39.571779 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 95/212] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:39 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 25322 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:26:39.783525 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2955548a-dea6-47e6-8d3a-af31ff6966fb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:39.784152 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2955548a-dea6-47e6-8d3a-af31ff6966fb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:39.790574 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2955548a-dea6-47e6-8d3a-af31ff6966fb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:39.791018 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2955548a-dea6-47e6-8d3a-af31ff6966fb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:39.791804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2955548a-dea6-47e6-8d3a-af31ff6966fb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:39.792501 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2955548a-dea6-47e6-8d3a-af31ff6966fb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:39.837325 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d987a8cc-04f2-47f7-8585-72e98520b592 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:39.838022 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d987a8cc-04f2-47f7-8585-72e98520b592 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:39.844595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d987a8cc-04f2-47f7-8585-72e98520b592 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:39.845065 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d987a8cc-04f2-47f7-8585-72e98520b592 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:39.845950 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d987a8cc-04f2-47f7-8585-72e98520b592 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:39.846367 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d987a8cc-04f2-47f7-8585-72e98520b592 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:39.930693 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2955548a-dea6-47e6-8d3a-af31ff6966fb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:39.937914 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2955548a-dea6-47e6-8d3a-af31ff6966fb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.158429 Jul 19 09:26:39.938482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 96/213] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:39 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:39.990032 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d987a8cc-04f2-47f7-8585-72e98520b592 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:39.998882 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d987a8cc-04f2-47f7-8585-72e98520b592 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 200 len: 1318 microversion: 2.1 time: 0.166214 Jul 19 09:26:39.999588 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 118/214] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:39 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:26:40.578740 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-58b14411-add7-4111-b61c-5243a4923fb4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:40.579354 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-da09ef29-d38b-470f-845d-2403dc3278e1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:40.579732 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-58b14411-add7-4111-b61c-5243a4923fb4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:40.579942 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-da09ef29-d38b-470f-845d-2403dc3278e1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:40.586076 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-58b14411-add7-4111-b61c-5243a4923fb4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:40.586220 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da09ef29-d38b-470f-845d-2403dc3278e1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:40.586521 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-58b14411-add7-4111-b61c-5243a4923fb4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:40.586618 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da09ef29-d38b-470f-845d-2403dc3278e1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:40.587314 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da09ef29-d38b-470f-845d-2403dc3278e1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:40.587411 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-58b14411-add7-4111-b61c-5243a4923fb4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:40.587744 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da09ef29-d38b-470f-845d-2403dc3278e1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:40.587870 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-58b14411-add7-4111-b61c-5243a4923fb4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:40.663493 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-da09ef29-d38b-470f-845d-2403dc3278e1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 25945 microversion: 2.20 time: 0.087922 Jul 19 09:26:40.664123 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 119/215] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:40 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 25945 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:26:40.681531 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-58b14411-add7-4111-b61c-5243a4923fb4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 28179 microversion: 2.1 time: 0.106406 Jul 19 09:26:40.682142 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 97/216] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:40 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 28179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:26:40.955092 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-00cb965b-ae11-4b46-8e90-dd76df757e92 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:40.955790 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-00cb965b-ae11-4b46-8e90-dd76df757e92 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:40.967162 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-00cb965b-ae11-4b46-8e90-dd76df757e92 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:40.967780 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-00cb965b-ae11-4b46-8e90-dd76df757e92 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:40.968741 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-00cb965b-ae11-4b46-8e90-dd76df757e92 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:40.969325 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-00cb965b-ae11-4b46-8e90-dd76df757e92 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:41.018212 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5eb45245-8efa-47ff-a02b-c373939cb450 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:41.018955 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5eb45245-8efa-47ff-a02b-c373939cb450 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:41.025434 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5eb45245-8efa-47ff-a02b-c373939cb450 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:41.026126 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5eb45245-8efa-47ff-a02b-c373939cb450 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:41.027376 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5eb45245-8efa-47ff-a02b-c373939cb450 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:41.028079 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5eb45245-8efa-47ff-a02b-c373939cb450 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:41.158320 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-00cb965b-ae11-4b46-8e90-dd76df757e92 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:41.166878 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-00cb965b-ae11-4b46-8e90-dd76df757e92 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.215693 Jul 19 09:26:41.168070 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 120/217] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:40 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:41.203448 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5eb45245-8efa-47ff-a02b-c373939cb450 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:41.210898 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5eb45245-8efa-47ff-a02b-c373939cb450 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 200 len: 1507 microversion: 2.1 time: 0.196808 Jul 19 09:26:41.211573 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 98/218] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:41 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:41.675271 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6d8cd1fe-66ae-441f-b357-ba29b69226f6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:41.677398 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6d8cd1fe-66ae-441f-b357-ba29b69226f6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:41.683530 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6d8cd1fe-66ae-441f-b357-ba29b69226f6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:41.684170 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6d8cd1fe-66ae-441f-b357-ba29b69226f6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:41.685102 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6d8cd1fe-66ae-441f-b357-ba29b69226f6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:41.685532 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6d8cd1fe-66ae-441f-b357-ba29b69226f6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:41.694139 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7af7ae92-7de5-4b5b-a5f0-f968c4dc48d3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:41.695377 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7af7ae92-7de5-4b5b-a5f0-f968c4dc48d3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:41.702093 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7af7ae92-7de5-4b5b-a5f0-f968c4dc48d3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:41.702679 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7af7ae92-7de5-4b5b-a5f0-f968c4dc48d3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:41.704646 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7af7ae92-7de5-4b5b-a5f0-f968c4dc48d3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:41.705617 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7af7ae92-7de5-4b5b-a5f0-f968c4dc48d3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:41.779001 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6d8cd1fe-66ae-441f-b357-ba29b69226f6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 26595 microversion: 2.20 time: 0.107258 Jul 19 09:26:41.782784 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 121/219] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:41 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 26595 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:26:41.790275 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7af7ae92-7de5-4b5b-a5f0-f968c4dc48d3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 28179 microversion: 2.1 time: 0.100815 Jul 19 09:26:41.790918 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 99/220] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:41 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 28179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:26:42.188849 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-70471fae-1559-4598-bd1d-f0941e12e3de tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:42.189576 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-70471fae-1559-4598-bd1d-f0941e12e3de tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:42.197127 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-70471fae-1559-4598-bd1d-f0941e12e3de tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:42.197588 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-70471fae-1559-4598-bd1d-f0941e12e3de tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:42.198379 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-70471fae-1559-4598-bd1d-f0941e12e3de tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:42.198812 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-70471fae-1559-4598-bd1d-f0941e12e3de tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:42.347050 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-70471fae-1559-4598-bd1d-f0941e12e3de tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:42.354954 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-70471fae-1559-4598-bd1d-f0941e12e3de tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.173934 Jul 19 09:26:42.355552 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 122/221] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:42 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:42.581809 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-12875ff9-c57d-4416-8903-fd294567d6fb tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f55443b-89e8-48d9-98ba-2b7769d03953"}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:42.582937 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-12875ff9-c57d-4416-8903-fd294567d6fb tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:42.589266 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12875ff9-c57d-4416-8903-fd294567d6fb tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:42.589723 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12875ff9-c57d-4416-8903-fd294567d6fb tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:42.590484 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12875ff9-c57d-4416-8903-fd294567d6fb tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:42.590917 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12875ff9-c57d-4416-8903-fd294567d6fb tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:42.790259 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d6b98294-1243-49b2-aa4a-25360d508aa4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:42.791289 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d6b98294-1243-49b2-aa4a-25360d508aa4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:42.799347 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d6b98294-1243-49b2-aa4a-25360d508aa4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:42.799799 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d6b98294-1243-49b2-aa4a-25360d508aa4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:42.800750 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d6b98294-1243-49b2-aa4a-25360d508aa4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:42.801183 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d6b98294-1243-49b2-aa4a-25360d508aa4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:45.377210 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d6b98294-1243-49b2-aa4a-25360d508aa4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 27768 microversion: 2.20 time: 2.591164 Jul 19 09:26:45.377846 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 123/222] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:42 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 27768 bytes in 2593 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:26:45.383418 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e74f23bb-fcae-4900-afb6-6f2015332a49 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:45.384450 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e74f23bb-fcae-4900-afb6-6f2015332a49 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:45.390827 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e74f23bb-fcae-4900-afb6-6f2015332a49 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:45.391361 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e74f23bb-fcae-4900-afb6-6f2015332a49 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:45.392124 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e74f23bb-fcae-4900-afb6-6f2015332a49 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:45.392552 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e74f23bb-fcae-4900-afb6-6f2015332a49 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:45.461648 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e74f23bb-fcae-4900-afb6-6f2015332a49 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 28179 microversion: 2.1 time: 0.082406 Jul 19 09:26:45.463354 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 124/223] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:45 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 28179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:26:45.467286 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-12fc3c42-4642-4eb8-b070-9aaee2dda2ba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:45.467975 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-12fc3c42-4642-4eb8-b070-9aaee2dda2ba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:45.474324 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12fc3c42-4642-4eb8-b070-9aaee2dda2ba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:45.474757 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12fc3c42-4642-4eb8-b070-9aaee2dda2ba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:45.475669 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12fc3c42-4642-4eb8-b070-9aaee2dda2ba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:45.476109 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12fc3c42-4642-4eb8-b070-9aaee2dda2ba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:45.501163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-12875ff9-c57d-4416-8903-fd294567d6fb tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "POST /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.923278 Jul 19 09:26:45.502048 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 100/224] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Jul 19 09:26:42 2021] POST /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f/os-volume_attachments => generated 194 bytes in 2925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:26:45.618681 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-12fc3c42-4642-4eb8-b070-9aaee2dda2ba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:45.626055 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-12fc3c42-4642-4eb8-b070-9aaee2dda2ba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.162499 Jul 19 09:26:45.626609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 125/225] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:45 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:46.389975 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-68660afe-7310-4ecc-9a4e-51004a2ea0ce tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:46.391085 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-68660afe-7310-4ecc-9a4e-51004a2ea0ce tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:46.398469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-68660afe-7310-4ecc-9a4e-51004a2ea0ce tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:46.398919 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-68660afe-7310-4ecc-9a4e-51004a2ea0ce tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:46.399727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-68660afe-7310-4ecc-9a4e-51004a2ea0ce tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:46.400164 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-68660afe-7310-4ecc-9a4e-51004a2ea0ce tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:46.472907 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-92f5898d-cde9-4773-8860-20a0f85f3843 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:46.474300 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-92f5898d-cde9-4773-8860-20a0f85f3843 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:46.480502 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-92f5898d-cde9-4773-8860-20a0f85f3843 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:46.480654 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-68660afe-7310-4ecc-9a4e-51004a2ea0ce tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 28176 microversion: 2.20 time: 0.094565 Jul 19 09:26:46.480949 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-92f5898d-cde9-4773-8860-20a0f85f3843 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:46.481524 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 101/226] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:46 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 28176 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:26:46.481715 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-92f5898d-cde9-4773-8860-20a0f85f3843 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:46.482149 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-92f5898d-cde9-4773-8860-20a0f85f3843 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:46.567966 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-92f5898d-cde9-4773-8860-20a0f85f3843 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 28179 microversion: 2.1 time: 0.097946 Jul 19 09:26:46.571795 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 126/227] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:46 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 28179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:26:46.643331 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-243f276b-7249-4d38-8b33-37d3476f526e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:46.644044 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-243f276b-7249-4d38-8b33-37d3476f526e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:46.652044 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-243f276b-7249-4d38-8b33-37d3476f526e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:46.652497 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-243f276b-7249-4d38-8b33-37d3476f526e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:46.653280 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-243f276b-7249-4d38-8b33-37d3476f526e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:46.653716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-243f276b-7249-4d38-8b33-37d3476f526e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:46.788287 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-243f276b-7249-4d38-8b33-37d3476f526e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:46.795811 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-243f276b-7249-4d38-8b33-37d3476f526e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.156715 Jul 19 09:26:46.796374 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 102/228] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:46 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:47.493209 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5940b269-ebde-4c04-b1ba-759a10f80d16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:47.494207 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5940b269-ebde-4c04-b1ba-759a10f80d16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:47.500588 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5940b269-ebde-4c04-b1ba-759a10f80d16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:47.501036 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5940b269-ebde-4c04-b1ba-759a10f80d16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:47.501794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5940b269-ebde-4c04-b1ba-759a10f80d16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:47.502223 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5940b269-ebde-4c04-b1ba-759a10f80d16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:47.579302 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7cc02c56-74ae-4aa0-bdfd-aa42d69fdeb2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:47.580241 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7cc02c56-74ae-4aa0-bdfd-aa42d69fdeb2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:47.580812 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5940b269-ebde-4c04-b1ba-759a10f80d16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 28176 microversion: 2.20 time: 0.092052 Jul 19 09:26:47.584613 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 127/229] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:47 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 28176 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:26:47.586179 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7cc02c56-74ae-4aa0-bdfd-aa42d69fdeb2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:47.586627 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7cc02c56-74ae-4aa0-bdfd-aa42d69fdeb2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:47.587419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7cc02c56-74ae-4aa0-bdfd-aa42d69fdeb2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:47.587852 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7cc02c56-74ae-4aa0-bdfd-aa42d69fdeb2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:47.737729 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7cc02c56-74ae-4aa0-bdfd-aa42d69fdeb2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 28179 microversion: 2.1 time: 0.161907 Jul 19 09:26:47.742497 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 103/230] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:47 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 28179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:26:47.813141 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f04757ce-390c-452a-8aa0-d2cd0239cfde tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:47.813997 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f04757ce-390c-452a-8aa0-d2cd0239cfde tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:47.820935 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f04757ce-390c-452a-8aa0-d2cd0239cfde tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:47.821619 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f04757ce-390c-452a-8aa0-d2cd0239cfde tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:47.822394 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f04757ce-390c-452a-8aa0-d2cd0239cfde tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:47.823068 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f04757ce-390c-452a-8aa0-d2cd0239cfde tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:47.997225 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f04757ce-390c-452a-8aa0-d2cd0239cfde tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:48.005895 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f04757ce-390c-452a-8aa0-d2cd0239cfde tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.196287 Jul 19 09:26:48.007295 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 128/231] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:47 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:48.596392 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1307ceba-1013-4035-9ed8-0ea268fa11e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:48.597984 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1307ceba-1013-4035-9ed8-0ea268fa11e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:48.604553 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1307ceba-1013-4035-9ed8-0ea268fa11e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:48.605198 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1307ceba-1013-4035-9ed8-0ea268fa11e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:48.606151 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1307ceba-1013-4035-9ed8-0ea268fa11e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:48.606755 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1307ceba-1013-4035-9ed8-0ea268fa11e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:48.682492 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1307ceba-1013-4035-9ed8-0ea268fa11e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 28176 microversion: 2.20 time: 0.089304 Jul 19 09:26:48.683342 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 104/232] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:48 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 28176 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:26:48.750193 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-24aaf399-ef92-4f8c-83aa-89434e138579 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:48.751157 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-24aaf399-ef92-4f8c-83aa-89434e138579 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:48.757955 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-24aaf399-ef92-4f8c-83aa-89434e138579 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:48.758419 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-24aaf399-ef92-4f8c-83aa-89434e138579 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:48.759232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-24aaf399-ef92-4f8c-83aa-89434e138579 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:48.759672 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-24aaf399-ef92-4f8c-83aa-89434e138579 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:48.839141 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-24aaf399-ef92-4f8c-83aa-89434e138579 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 28470 microversion: 2.1 time: 0.092939 Jul 19 09:26:48.839793 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 129/233] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:48 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 28470 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:26:49.024093 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3f46d847-da3e-4769-b186-af1e9e47b906 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:49.024887 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3f46d847-da3e-4769-b186-af1e9e47b906 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:49.031626 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3f46d847-da3e-4769-b186-af1e9e47b906 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:49.032301 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3f46d847-da3e-4769-b186-af1e9e47b906 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:49.033149 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3f46d847-da3e-4769-b186-af1e9e47b906 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:49.033706 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3f46d847-da3e-4769-b186-af1e9e47b906 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:49.191693 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3f46d847-da3e-4769-b186-af1e9e47b906 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:49.200217 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3f46d847-da3e-4769-b186-af1e9e47b906 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.180478 Jul 19 09:26:49.200885 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 105/234] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:49 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:49.698121 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-79814446-d09f-4c74-ba3d-4147ce03706c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:49.699961 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-79814446-d09f-4c74-ba3d-4147ce03706c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:49.707237 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-79814446-d09f-4c74-ba3d-4147ce03706c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:49.708551 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-79814446-d09f-4c74-ba3d-4147ce03706c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:49.709645 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-79814446-d09f-4c74-ba3d-4147ce03706c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:49.710251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-79814446-d09f-4c74-ba3d-4147ce03706c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:49.805390 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-79814446-d09f-4c74-ba3d-4147ce03706c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 28176 microversion: 2.20 time: 0.111375 Jul 19 09:26:49.807107 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 130/235] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:49 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 28176 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:26:49.858503 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8f570117-3f17-41e5-9bcb-197d3999f086 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:49.858503 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8f570117-3f17-41e5-9bcb-197d3999f086 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:49.861124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8f570117-3f17-41e5-9bcb-197d3999f086 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:49.861566 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8f570117-3f17-41e5-9bcb-197d3999f086 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:49.866659 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8f570117-3f17-41e5-9bcb-197d3999f086 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:49.867335 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8f570117-3f17-41e5-9bcb-197d3999f086 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:49.944541 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8f570117-3f17-41e5-9bcb-197d3999f086 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 28470 microversion: 2.1 time: 0.096195 Jul 19 09:26:49.945297 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 106/236] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:49 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 28470 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:26:50.219315 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8df34432-4229-402b-b64e-9a426eaebe59 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:50.219315 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8df34432-4229-402b-b64e-9a426eaebe59 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:50.225645 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8df34432-4229-402b-b64e-9a426eaebe59 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:50.226102 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8df34432-4229-402b-b64e-9a426eaebe59 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:50.226916 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8df34432-4229-402b-b64e-9a426eaebe59 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:50.227389 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8df34432-4229-402b-b64e-9a426eaebe59 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:50.387186 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8df34432-4229-402b-b64e-9a426eaebe59 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:50.395017 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8df34432-4229-402b-b64e-9a426eaebe59 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.181224 Jul 19 09:26:50.405231 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 131/237] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:50 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:50.817365 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-21494d3e-592c-4a74-8cba-3f08942bfc37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:50.819384 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-21494d3e-592c-4a74-8cba-3f08942bfc37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:50.826215 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-21494d3e-592c-4a74-8cba-3f08942bfc37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:50.826669 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-21494d3e-592c-4a74-8cba-3f08942bfc37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:50.827474 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-21494d3e-592c-4a74-8cba-3f08942bfc37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:50.827905 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-21494d3e-592c-4a74-8cba-3f08942bfc37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:50.956493 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6cab5276-8836-4852-8003-0eb8b75981d8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:50.957450 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6cab5276-8836-4852-8003-0eb8b75981d8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:50.963884 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6cab5276-8836-4852-8003-0eb8b75981d8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:50.964331 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6cab5276-8836-4852-8003-0eb8b75981d8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:50.974345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6cab5276-8836-4852-8003-0eb8b75981d8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:50.974345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6cab5276-8836-4852-8003-0eb8b75981d8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:53.400435 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-21494d3e-592c-4a74-8cba-3f08942bfc37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 28467 microversion: 2.20 time: 2.586938 Jul 19 09:26:53.401331 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 107/238] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:50 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 28467 bytes in 2589 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:26:53.406033 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-67e737e2-a868-4a28-bea8-6944ee2eff2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:53.406730 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-67e737e2-a868-4a28-bea8-6944ee2eff2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:53.412515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6cab5276-8836-4852-8003-0eb8b75981d8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 28636 microversion: 2.1 time: 2.459677 Jul 19 09:26:53.413152 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 132/239] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:50 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 28636 bytes in 2461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:26:53.413293 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-67e737e2-a868-4a28-bea8-6944ee2eff2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:53.413626 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-67e737e2-a868-4a28-bea8-6944ee2eff2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:53.414396 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-67e737e2-a868-4a28-bea8-6944ee2eff2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:53.414834 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-67e737e2-a868-4a28-bea8-6944ee2eff2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:53.552259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-67e737e2-a868-4a28-bea8-6944ee2eff2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:53.559394 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-67e737e2-a868-4a28-bea8-6944ee2eff2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.157074 Jul 19 09:26:53.559897 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 108/240] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:53 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:54.414511 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2249a8e6-fb2c-4cee-93a2-03ddf064f5e5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:54.415592 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2249a8e6-fb2c-4cee-93a2-03ddf064f5e5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:54.422826 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2249a8e6-fb2c-4cee-93a2-03ddf064f5e5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:54.423386 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2249a8e6-fb2c-4cee-93a2-03ddf064f5e5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:54.424450 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2249a8e6-fb2c-4cee-93a2-03ddf064f5e5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:54.424911 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2249a8e6-fb2c-4cee-93a2-03ddf064f5e5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:54.425904 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-37002b6c-8589-417d-85be-b117b6e4bc42 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:54.427053 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-37002b6c-8589-417d-85be-b117b6e4bc42 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:54.435278 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-37002b6c-8589-417d-85be-b117b6e4bc42 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:54.436086 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-37002b6c-8589-417d-85be-b117b6e4bc42 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:54.436911 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-37002b6c-8589-417d-85be-b117b6e4bc42 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:54.437325 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-37002b6c-8589-417d-85be-b117b6e4bc42 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:54.530156 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-37002b6c-8589-417d-85be-b117b6e4bc42 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 28636 microversion: 2.1 time: 0.109565 Jul 19 09:26:54.530945 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 109/241] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:54 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 28636 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:26:54.534857 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2249a8e6-fb2c-4cee-93a2-03ddf064f5e5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 28467 microversion: 2.20 time: 0.125154 Jul 19 09:26:54.537123 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 133/242] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:54 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 28467 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:26:54.577557 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1c9a200d-d1bc-4d1a-8d96-fc33be8f76f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:54.589107 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1c9a200d-d1bc-4d1a-8d96-fc33be8f76f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:54.596109 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c9a200d-d1bc-4d1a-8d96-fc33be8f76f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:54.596637 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c9a200d-d1bc-4d1a-8d96-fc33be8f76f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:54.597335 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c9a200d-d1bc-4d1a-8d96-fc33be8f76f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:54.597773 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c9a200d-d1bc-4d1a-8d96-fc33be8f76f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:54.762589 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1c9a200d-d1bc-4d1a-8d96-fc33be8f76f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:54.772452 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1c9a200d-d1bc-4d1a-8d96-fc33be8f76f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.199441 Jul 19 09:26:54.780303 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 110/243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:54 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:55.168394 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2006165537", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452", "networks": [{"uuid": "ffe762f0-68bd-4db8-b328-c8e2b8fc1624"}]}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:55.224901 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.network.neutron [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] validate_networks() for [('ffe762f0-68bd-4db8-b328-c8e2b8fc1624', None, None, None)] {{(pid=107463) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:26:55.544000 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f38d7c8e-3f24-44da-9796-1326e68cf2db tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:55.544916 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f38d7c8e-3f24-44da-9796-1326e68cf2db tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:55.550550 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f38d7c8e-3f24-44da-9796-1326e68cf2db tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:55.550992 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f38d7c8e-3f24-44da-9796-1326e68cf2db tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:55.552408 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f38d7c8e-3f24-44da-9796-1326e68cf2db tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:55.552836 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f38d7c8e-3f24-44da-9796-1326e68cf2db tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:55.610258 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Flavor limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:26:55.610834 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Image limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:26:55.611289 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Flavor pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:26:55.611702 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Image pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:26:55.612142 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:26:55.623065 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f38d7c8e-3f24-44da-9796-1326e68cf2db tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 28636 microversion: 2.1 time: 0.084419 Jul 19 09:26:55.623382 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:55.623712 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 111/244] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:55 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 28636 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:26:55.623820 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:55.624633 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:55.625145 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:55.628624 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0a7845ad-463d-464f-90e2-66c523a89665 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:55.629639 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0a7845ad-463d-464f-90e2-66c523a89665 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:55.636053 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0a7845ad-463d-464f-90e2-66c523a89665 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:55.636505 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0a7845ad-463d-464f-90e2-66c523a89665 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:55.637274 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0a7845ad-463d-464f-90e2-66c523a89665 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:55.637714 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0a7845ad-463d-464f-90e2-66c523a89665 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:55.644816 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Getting quotas for project 4427b775629d442d9448281ff5171b24. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:26:55.649370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Getting quotas for user 6b45b7dbaf5c41a998a64ef62132ea6d and project 4427b775629d442d9448281ff5171b24. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:26:55.661887 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Going to run 1 instances... {{(pid=107463) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:26:55.665533 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:26:55.712135 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-19453974-7d4a-480e-89e7-22a23286bb9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548001 Jul 19 09:26:55.712777 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 134/245] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 09:26:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 09:26:55.722464 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-eb8c7741-fce2-479f-828a-ca85d0ef2d6a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:55.723688 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-eb8c7741-fce2-479f-828a-ca85d0ef2d6a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:55.728351 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0a7845ad-463d-464f-90e2-66c523a89665 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 28634 microversion: 2.20 time: 0.103238 Jul 19 09:26:55.728989 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 112/246] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:55 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 28634 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:26:55.782743 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-eb8c7741-fce2-479f-828a-ca85d0ef2d6a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:55.792371 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-eb8c7741-fce2-479f-828a-ca85d0ef2d6a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 200 len: 1218 microversion: 2.1 time: 0.073278 Jul 19 09:26:55.792949 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 135/247] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:55 2021] GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:55.794278 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5d1765f5-2c4f-4dad-9e4b-56736d0285e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:55.795276 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5d1765f5-2c4f-4dad-9e4b-56736d0285e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:55.802020 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5d1765f5-2c4f-4dad-9e4b-56736d0285e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:55.802671 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5d1765f5-2c4f-4dad-9e4b-56736d0285e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:55.803561 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5d1765f5-2c4f-4dad-9e4b-56736d0285e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:55.804091 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5d1765f5-2c4f-4dad-9e4b-56736d0285e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:55.963425 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5d1765f5-2c4f-4dad-9e4b-56736d0285e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:55.972491 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5d1765f5-2c4f-4dad-9e4b-56736d0285e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.183780 Jul 19 09:26:55.973068 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 113/248] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:55 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:56.635578 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-308f63fb-ead2-4580-bdaa-864ceea399e7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:56.636642 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-308f63fb-ead2-4580-bdaa-864ceea399e7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:56.644796 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-308f63fb-ead2-4580-bdaa-864ceea399e7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:56.645332 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-308f63fb-ead2-4580-bdaa-864ceea399e7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:56.646539 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-308f63fb-ead2-4580-bdaa-864ceea399e7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:56.647067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-308f63fb-ead2-4580-bdaa-864ceea399e7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:56.739756 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-36cf67cb-f00d-4a03-89ca-d7c6fcf27859 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:56.740677 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-36cf67cb-f00d-4a03-89ca-d7c6fcf27859 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:56.750725 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-308f63fb-ead2-4580-bdaa-864ceea399e7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 28636 microversion: 2.1 time: 0.118531 Jul 19 09:26:56.751450 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 136/249] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:56 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 28636 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:26:56.755797 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-36cf67cb-f00d-4a03-89ca-d7c6fcf27859 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:56.756252 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-36cf67cb-f00d-4a03-89ca-d7c6fcf27859 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:56.757032 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-36cf67cb-f00d-4a03-89ca-d7c6fcf27859 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:56.757468 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-36cf67cb-f00d-4a03-89ca-d7c6fcf27859 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:56.808688 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9413c65f-923f-435b-b598-dd3137067254 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:56.809471 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9413c65f-923f-435b-b598-dd3137067254 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:56.818799 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9413c65f-923f-435b-b598-dd3137067254 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:56.819273 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9413c65f-923f-435b-b598-dd3137067254 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:56.820050 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9413c65f-923f-435b-b598-dd3137067254 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:56.820480 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9413c65f-923f-435b-b598-dd3137067254 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:56.840219 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-36cf67cb-f00d-4a03-89ca-d7c6fcf27859 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 28634 microversion: 2.20 time: 0.104799 Jul 19 09:26:56.841424 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 114/250] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:56 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 28634 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:26:56.907015 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9413c65f-923f-435b-b598-dd3137067254 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:56.917428 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9413c65f-923f-435b-b598-dd3137067254 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 200 len: 1270 microversion: 2.1 time: 0.112383 Jul 19 09:26:56.917998 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 137/251] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:56 2021] GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 1270 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:26:56.992384 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6e8fc5f7-f91e-413e-94c6-1164c1b4cc29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:56.993482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6e8fc5f7-f91e-413e-94c6-1164c1b4cc29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:57.003000 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e8fc5f7-f91e-413e-94c6-1164c1b4cc29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:57.004200 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e8fc5f7-f91e-413e-94c6-1164c1b4cc29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:57.005535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e8fc5f7-f91e-413e-94c6-1164c1b4cc29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:57.006044 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e8fc5f7-f91e-413e-94c6-1164c1b4cc29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:57.255403 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6e8fc5f7-f91e-413e-94c6-1164c1b4cc29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:57.275305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6e8fc5f7-f91e-413e-94c6-1164c1b4cc29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.289201 Jul 19 09:26:57.275970 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 115/252] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:56 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:57.764398 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-82cc2c5f-6d13-45a2-9656-0fa202508d16 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:57.768829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-82cc2c5f-6d13-45a2-9656-0fa202508d16 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:57.779086 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-82cc2c5f-6d13-45a2-9656-0fa202508d16 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:57.779534 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-82cc2c5f-6d13-45a2-9656-0fa202508d16 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:57.781285 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-82cc2c5f-6d13-45a2-9656-0fa202508d16 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:57.782071 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-82cc2c5f-6d13-45a2-9656-0fa202508d16 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:57.853019 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5724e6ed-7903-4a56-92ab-503535dbf9ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:57.853949 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5724e6ed-7903-4a56-92ab-503535dbf9ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:57.867264 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5724e6ed-7903-4a56-92ab-503535dbf9ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:57.867731 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5724e6ed-7903-4a56-92ab-503535dbf9ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:57.868531 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5724e6ed-7903-4a56-92ab-503535dbf9ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:57.868975 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5724e6ed-7903-4a56-92ab-503535dbf9ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:57.950717 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-82cc2c5f-6d13-45a2-9656-0fa202508d16 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 28636 microversion: 2.1 time: 0.190250 Jul 19 09:26:57.951901 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 138/253] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:57 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 28636 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:26:57.957864 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7d1658c2-0025-4e7f-b943-d5b1e45b7c69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:57.958782 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7d1658c2-0025-4e7f-b943-d5b1e45b7c69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:57.966434 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7d1658c2-0025-4e7f-b943-d5b1e45b7c69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:57.967406 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7d1658c2-0025-4e7f-b943-d5b1e45b7c69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:57.968680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7d1658c2-0025-4e7f-b943-d5b1e45b7c69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:57.969372 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7d1658c2-0025-4e7f-b943-d5b1e45b7c69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:57.977929 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5724e6ed-7903-4a56-92ab-503535dbf9ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 28634 microversion: 2.20 time: 0.129175 Jul 19 09:26:57.979343 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 116/254] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:57 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 28634 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:26:58.166097 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7d1658c2-0025-4e7f-b943-d5b1e45b7c69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:58.179609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7d1658c2-0025-4e7f-b943-d5b1e45b7c69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 200 len: 1318 microversion: 2.1 time: 0.226122 Jul 19 09:26:58.180571 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 139/255] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:57 2021] GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:58.293964 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a87b9c35-8edd-42ae-ad16-9955e3dee605 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:58.294787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a87b9c35-8edd-42ae-ad16-9955e3dee605 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:58.303227 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a87b9c35-8edd-42ae-ad16-9955e3dee605 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:58.303832 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a87b9c35-8edd-42ae-ad16-9955e3dee605 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:58.304715 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a87b9c35-8edd-42ae-ad16-9955e3dee605 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:58.305255 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a87b9c35-8edd-42ae-ad16-9955e3dee605 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:58.811429 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a87b9c35-8edd-42ae-ad16-9955e3dee605 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:58.820311 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a87b9c35-8edd-42ae-ad16-9955e3dee605 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.531250 Jul 19 09:26:58.821633 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 117/256] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:58 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:58.971957 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6ecdcf51-25a4-470b-b446-9e2bf4eeb68f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:58.974814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6ecdcf51-25a4-470b-b446-9e2bf4eeb68f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:58.993630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c141cebe-d9c4-49da-a071-73f5f5afa9a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:58.995002 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6ecdcf51-25a4-470b-b446-9e2bf4eeb68f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:58.995473 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6ecdcf51-25a4-470b-b446-9e2bf4eeb68f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:58.995722 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c141cebe-d9c4-49da-a071-73f5f5afa9a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:58.996489 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6ecdcf51-25a4-470b-b446-9e2bf4eeb68f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:58.996917 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6ecdcf51-25a4-470b-b446-9e2bf4eeb68f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:59.002320 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c141cebe-d9c4-49da-a071-73f5f5afa9a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:59.002968 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c141cebe-d9c4-49da-a071-73f5f5afa9a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:59.003788 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c141cebe-d9c4-49da-a071-73f5f5afa9a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:59.004504 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c141cebe-d9c4-49da-a071-73f5f5afa9a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:59.103917 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6ecdcf51-25a4-470b-b446-9e2bf4eeb68f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 28636 microversion: 2.1 time: 0.144971 Jul 19 09:26:59.104550 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 140/257] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:26:58 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 28636 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:26:59.112183 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-e3d0aecd-698b-4f86-86bb-e38fbf00932a req-1f03305a-9c54-4baa-aedb-ec846e697b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648", "tag": "d9568367-e6a4-4455-8e55-2aa4ddaf098f"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:26:59.112912 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c141cebe-d9c4-49da-a071-73f5f5afa9a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 28634 microversion: 2.20 time: 0.122443 Jul 19 09:26:59.114238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:26:59.114238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:26:59.114883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 118/258] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:26:58 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 28634 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:26:59.130141 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-e3d0aecd-698b-4f86-86bb-e38fbf00932a req-1f03305a-9c54-4baa-aedb-ec846e697b61 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:59.131173 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-e3d0aecd-698b-4f86-86bb-e38fbf00932a req-1f03305a-9c54-4baa-aedb-ec846e697b61 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:59.161502 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-e3d0aecd-698b-4f86-86bb-e38fbf00932a req-1f03305a-9c54-4baa-aedb-ec846e697b61 service nova] Creating event network-changed:d9568367-e6a4-4455-8e55-2aa4ddaf098f for instance 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 on hv-cinder-79338 Jul 19 09:26:59.172959 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-e3d0aecd-698b-4f86-86bb-e38fbf00932a req-1f03305a-9c54-4baa-aedb-ec846e697b61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067013 Jul 19 09:26:59.175670 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 141/259] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:26:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:26:59.201853 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-70854d61-9440-4f27-bd78-2af9837a6072 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:59.202955 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-70854d61-9440-4f27-bd78-2af9837a6072 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:59.212021 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70854d61-9440-4f27-bd78-2af9837a6072 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:59.212874 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70854d61-9440-4f27-bd78-2af9837a6072 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:59.214125 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70854d61-9440-4f27-bd78-2af9837a6072 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:59.214946 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70854d61-9440-4f27-bd78-2af9837a6072 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:59.500735 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-70854d61-9440-4f27-bd78-2af9837a6072 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:26:59.510784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-70854d61-9440-4f27-bd78-2af9837a6072 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 200 len: 1318 microversion: 2.1 time: 0.316591 Jul 19 09:26:59.521332 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 119/260] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:59 2021] GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:26:59.850149 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2cbffb7c-0c6d-4ffa-9cdd-2450dad29516 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:26:59.850149 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2cbffb7c-0c6d-4ffa-9cdd-2450dad29516 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:26:59.850149 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2cbffb7c-0c6d-4ffa-9cdd-2450dad29516 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:59.850149 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2cbffb7c-0c6d-4ffa-9cdd-2450dad29516 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:26:59.850958 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2cbffb7c-0c6d-4ffa-9cdd-2450dad29516 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:26:59.850958 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2cbffb7c-0c6d-4ffa-9cdd-2450dad29516 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:00.115581 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5791e36f-a342-47f8-b1f2-8c11a2cc1a9f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:00.117174 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5791e36f-a342-47f8-b1f2-8c11a2cc1a9f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:00.129766 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5791e36f-a342-47f8-b1f2-8c11a2cc1a9f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:00.130453 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5791e36f-a342-47f8-b1f2-8c11a2cc1a9f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:00.132964 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5791e36f-a342-47f8-b1f2-8c11a2cc1a9f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:00.133624 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5791e36f-a342-47f8-b1f2-8c11a2cc1a9f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:00.201539 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2cbffb7c-0c6d-4ffa-9cdd-2450dad29516 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:00.224481 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2cbffb7c-0c6d-4ffa-9cdd-2450dad29516 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.384216 Jul 19 09:27:00.225306 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 142/261] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:26:59 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:00.234863 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-fbb30e8e-4689-4bbe-80db-2ce566ff823f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:00.236032 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-fbb30e8e-4689-4bbe-80db-2ce566ff823f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:00.247445 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fbb30e8e-4689-4bbe-80db-2ce566ff823f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:00.251247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fbb30e8e-4689-4bbe-80db-2ce566ff823f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:00.252361 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fbb30e8e-4689-4bbe-80db-2ce566ff823f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:00.252956 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fbb30e8e-4689-4bbe-80db-2ce566ff823f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:00.253584 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5791e36f-a342-47f8-b1f2-8c11a2cc1a9f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 28636 microversion: 2.1 time: 0.141648 Jul 19 09:27:00.254265 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 120/262] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:00 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 28636 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:00.446158 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-fbb30e8e-4689-4bbe-80db-2ce566ff823f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 28634 microversion: 2.20 time: 0.218990 Jul 19 09:27:00.450056 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 143/263] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:00 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 28634 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:27:00.530673 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-11dba88c-f5f9-45b9-81a8-3fca70b61638 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:00.532668 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-11dba88c-f5f9-45b9-81a8-3fca70b61638 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:00.543679 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-11dba88c-f5f9-45b9-81a8-3fca70b61638 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:00.544913 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-11dba88c-f5f9-45b9-81a8-3fca70b61638 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:00.545908 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-11dba88c-f5f9-45b9-81a8-3fca70b61638 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:00.546939 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-11dba88c-f5f9-45b9-81a8-3fca70b61638 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:00.772448 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-11dba88c-f5f9-45b9-81a8-3fca70b61638 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:00.785210 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-11dba88c-f5f9-45b9-81a8-3fca70b61638 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 200 len: 1318 microversion: 2.1 time: 0.260499 Jul 19 09:27:00.787657 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 121/264] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:00 2021] GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:01.242394 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ef74c0c4-0018-441e-985a-63b0fa3dcc76 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:01.243849 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ef74c0c4-0018-441e-985a-63b0fa3dcc76 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:01.250466 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ef74c0c4-0018-441e-985a-63b0fa3dcc76 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:01.250992 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ef74c0c4-0018-441e-985a-63b0fa3dcc76 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:01.251882 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ef74c0c4-0018-441e-985a-63b0fa3dcc76 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:01.252413 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ef74c0c4-0018-441e-985a-63b0fa3dcc76 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:01.266212 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f18e5bc3-4f4a-406b-af82-cfb0fb8d682d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:01.268283 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f18e5bc3-4f4a-406b-af82-cfb0fb8d682d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:01.279361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f18e5bc3-4f4a-406b-af82-cfb0fb8d682d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:01.280137 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f18e5bc3-4f4a-406b-af82-cfb0fb8d682d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:01.281323 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f18e5bc3-4f4a-406b-af82-cfb0fb8d682d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:01.281965 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f18e5bc3-4f4a-406b-af82-cfb0fb8d682d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:01.453977 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f18e5bc3-4f4a-406b-af82-cfb0fb8d682d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 29274 microversion: 2.1 time: 0.191734 Jul 19 09:27:01.454940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 122/265] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:01 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 29274 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:27:01.465458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2978def4-0213-43e0-9f67-c0a60ee2d57a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:01.466500 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2978def4-0213-43e0-9f67-c0a60ee2d57a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:01.473217 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2978def4-0213-43e0-9f67-c0a60ee2d57a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:01.473749 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2978def4-0213-43e0-9f67-c0a60ee2d57a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:01.474554 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2978def4-0213-43e0-9f67-c0a60ee2d57a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:01.475202 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2978def4-0213-43e0-9f67-c0a60ee2d57a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:01.558958 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2978def4-0213-43e0-9f67-c0a60ee2d57a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 28634 microversion: 2.20 time: 0.102196 Jul 19 09:27:01.559928 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 123/266] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:01 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 28634 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:27:01.805116 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6742661f-aba5-440c-bf4b-d5f1121f5909 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:01.805843 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6742661f-aba5-440c-bf4b-d5f1121f5909 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:01.812361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6742661f-aba5-440c-bf4b-d5f1121f5909 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:01.812900 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6742661f-aba5-440c-bf4b-d5f1121f5909 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:01.813732 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6742661f-aba5-440c-bf4b-d5f1121f5909 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:01.814236 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6742661f-aba5-440c-bf4b-d5f1121f5909 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:01.879369 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ef74c0c4-0018-441e-985a-63b0fa3dcc76 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:01.886879 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ef74c0c4-0018-441e-985a-63b0fa3dcc76 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1523 microversion: 2.1 time: 0.648538 Jul 19 09:27:01.887629 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 144/267] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:01 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1523 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:01.961063 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6742661f-aba5-440c-bf4b-d5f1121f5909 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:01.968764 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6742661f-aba5-440c-bf4b-d5f1121f5909 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 200 len: 1318 microversion: 2.1 time: 0.167758 Jul 19 09:27:01.969341 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 124/268] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:01 2021] GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:02.472528 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5f2dc12c-38ac-48b9-b204-9e4477a464ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:02.474220 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5f2dc12c-38ac-48b9-b204-9e4477a464ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:02.487176 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f2dc12c-38ac-48b9-b204-9e4477a464ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:02.489780 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f2dc12c-38ac-48b9-b204-9e4477a464ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:02.491137 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f2dc12c-38ac-48b9-b204-9e4477a464ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:02.493301 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f2dc12c-38ac-48b9-b204-9e4477a464ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:02.575798 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1f4bf3b7-8a61-4c69-a107-0b270cf069d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:02.579123 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1f4bf3b7-8a61-4c69-a107-0b270cf069d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:02.595985 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1f4bf3b7-8a61-4c69-a107-0b270cf069d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:02.596733 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1f4bf3b7-8a61-4c69-a107-0b270cf069d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:02.597865 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1f4bf3b7-8a61-4c69-a107-0b270cf069d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:02.599056 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1f4bf3b7-8a61-4c69-a107-0b270cf069d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:02.605073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5f2dc12c-38ac-48b9-b204-9e4477a464ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 30199 microversion: 2.1 time: 0.136004 Jul 19 09:27:02.605676 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 145/269] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:02 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 30199 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:02.702670 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1f4bf3b7-8a61-4c69-a107-0b270cf069d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 29553 microversion: 2.20 time: 0.133371 Jul 19 09:27:02.706938 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 125/270] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:02 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 29553 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:27:02.909328 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-76b7bf79-fecb-4e72-869d-6a7488750a8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:02.911063 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-76b7bf79-fecb-4e72-869d-6a7488750a8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:02.929073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-76b7bf79-fecb-4e72-869d-6a7488750a8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:02.929404 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-76b7bf79-fecb-4e72-869d-6a7488750a8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:02.930221 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-76b7bf79-fecb-4e72-869d-6a7488750a8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:02.930662 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-76b7bf79-fecb-4e72-869d-6a7488750a8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:02.986958 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0c55731e-ea36-4739-aaf6-7f51a742d54e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:02.988059 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0c55731e-ea36-4739-aaf6-7f51a742d54e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:03.003397 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c55731e-ea36-4739-aaf6-7f51a742d54e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:03.004163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c55731e-ea36-4739-aaf6-7f51a742d54e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:03.005135 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c55731e-ea36-4739-aaf6-7f51a742d54e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:03.005727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c55731e-ea36-4739-aaf6-7f51a742d54e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:03.089230 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-76b7bf79-fecb-4e72-869d-6a7488750a8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:03.098868 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-76b7bf79-fecb-4e72-869d-6a7488750a8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1503 microversion: 2.1 time: 0.195625 Jul 19 09:27:03.099708 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 146/271] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:02 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:03.118953 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-fd240bac-4415-4ed2-b5ad-d5f34b2e1903 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:03.119603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-fd240bac-4415-4ed2-b5ad-d5f34b2e1903 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:03.128642 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fd240bac-4415-4ed2-b5ad-d5f34b2e1903 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:03.129134 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fd240bac-4415-4ed2-b5ad-d5f34b2e1903 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:03.129914 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fd240bac-4415-4ed2-b5ad-d5f34b2e1903 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:03.130355 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fd240bac-4415-4ed2-b5ad-d5f34b2e1903 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:03.277910 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0c55731e-ea36-4739-aaf6-7f51a742d54e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:03.288453 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0c55731e-ea36-4739-aaf6-7f51a742d54e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 200 len: 1318 microversion: 2.1 time: 0.305219 Jul 19 09:27:03.300016 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 126/272] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:02 2021] GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:03.309976 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-fd240bac-4415-4ed2-b5ad-d5f34b2e1903 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:03.317977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-fd240bac-4415-4ed2-b5ad-d5f34b2e1903 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1517 microversion: 2.1 time: 0.206574 Jul 19 09:27:03.318876 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 147/273] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:03 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:03.617621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c8ed0a93-75f5-4dc4-b80b-f60b0c02010f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:03.618635 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c8ed0a93-75f5-4dc4-b80b-f60b0c02010f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:03.624746 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c8ed0a93-75f5-4dc4-b80b-f60b0c02010f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:03.625204 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c8ed0a93-75f5-4dc4-b80b-f60b0c02010f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:03.625991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c8ed0a93-75f5-4dc4-b80b-f60b0c02010f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:03.626486 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c8ed0a93-75f5-4dc4-b80b-f60b0c02010f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:03.718708 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-99078a62-d440-4060-8a46-60420e61792e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:03.720453 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-99078a62-d440-4060-8a46-60420e61792e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:03.734647 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-99078a62-d440-4060-8a46-60420e61792e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:03.735184 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-99078a62-d440-4060-8a46-60420e61792e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:03.738167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-99078a62-d440-4060-8a46-60420e61792e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:03.739224 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-99078a62-d440-4060-8a46-60420e61792e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:03.777864 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c8ed0a93-75f5-4dc4-b80b-f60b0c02010f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 31899 microversion: 2.1 time: 0.165350 Jul 19 09:27:03.783392 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 127/274] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:03 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 31899 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:03.880192 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-99078a62-d440-4060-8a46-60420e61792e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 30521 microversion: 2.20 time: 0.169221 Jul 19 09:27:03.885283 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 148/275] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:03 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 30521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:27:04.306546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a50bdacb-391a-4ba8-a049-d520f31b848c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:04.307295 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a50bdacb-391a-4ba8-a049-d520f31b848c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:04.323354 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a50bdacb-391a-4ba8-a049-d520f31b848c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:04.324023 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a50bdacb-391a-4ba8-a049-d520f31b848c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:04.325076 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a50bdacb-391a-4ba8-a049-d520f31b848c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:04.325688 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a50bdacb-391a-4ba8-a049-d520f31b848c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:04.644375 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a50bdacb-391a-4ba8-a049-d520f31b848c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:04.653631 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a50bdacb-391a-4ba8-a049-d520f31b848c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 200 len: 1318 microversion: 2.1 time: 0.351049 Jul 19 09:27:04.654520 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 128/276] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:04 2021] GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:04.790991 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b6d2e898-5f78-4480-9c3c-e00db09326bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:04.792814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b6d2e898-5f78-4480-9c3c-e00db09326bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:04.800754 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6d2e898-5f78-4480-9c3c-e00db09326bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:04.801255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6d2e898-5f78-4480-9c3c-e00db09326bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:04.806477 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6d2e898-5f78-4480-9c3c-e00db09326bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:04.806921 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6d2e898-5f78-4480-9c3c-e00db09326bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:04.896177 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-45f0f852-c60f-4e4b-b9a7-75712c0496ba tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:04.897272 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-45f0f852-c60f-4e4b-b9a7-75712c0496ba tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:04.906928 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45f0f852-c60f-4e4b-b9a7-75712c0496ba tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:04.907776 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45f0f852-c60f-4e4b-b9a7-75712c0496ba tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:04.908848 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45f0f852-c60f-4e4b-b9a7-75712c0496ba tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:04.909751 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45f0f852-c60f-4e4b-b9a7-75712c0496ba tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:04.928226 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b6d2e898-5f78-4480-9c3c-e00db09326bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 32523 microversion: 2.1 time: 0.141124 Jul 19 09:27:04.929437 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 149/277] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:04 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 32523 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:04.937697 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f287a753-1c6c-4424-85c7-37942af471a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:04.941515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f287a753-1c6c-4424-85c7-37942af471a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:04.954934 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f287a753-1c6c-4424-85c7-37942af471a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:04.962192 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f287a753-1c6c-4424-85c7-37942af471a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:04.963159 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f287a753-1c6c-4424-85c7-37942af471a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:04.963922 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f287a753-1c6c-4424-85c7-37942af471a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:04.993615 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.objects.instance [None req-f287a753-1c6c-4424-85c7-37942af471a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lazy-loading 'flavor' on Instance uuid 0ee4430d-0d5f-45bd-848e-aa6f05870b67 {{(pid=107463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:27:05.003210 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-45f0f852-c60f-4e4b-b9a7-75712c0496ba tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 31287 microversion: 2.20 time: 0.113868 Jul 19 09:27:05.005647 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 129/278] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:04 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 31287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:27:05.108264 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f287a753-1c6c-4424-85c7-37942af471a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "POST /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/action" status: 200 len: 32 microversion: 2.1 time: 0.176863 Jul 19 09:27:05.108940 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 150/279] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:04 2021] POST /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:27:05.118252 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c3b74adb-cfe9-4901-a0f3-b251de7e6163 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:05.119312 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c3b74adb-cfe9-4901-a0f3-b251de7e6163 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:05.128548 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3b74adb-cfe9-4901-a0f3-b251de7e6163 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:05.129632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3b74adb-cfe9-4901-a0f3-b251de7e6163 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:05.130502 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3b74adb-cfe9-4901-a0f3-b251de7e6163 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:05.130938 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3b74adb-cfe9-4901-a0f3-b251de7e6163 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:05.375163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c3b74adb-cfe9-4901-a0f3-b251de7e6163 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:05.383164 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c3b74adb-cfe9-4901-a0f3-b251de7e6163 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.268836 Jul 19 09:27:05.384378 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 130/280] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:05 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:05.674656 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e4d740e8-c94d-4361-bdf7-9220df66f591 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:05.675529 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e4d740e8-c94d-4361-bdf7-9220df66f591 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:05.680932 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-70585fa2-0f39-482a-9a67-edc02fff2e98 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c2669ca-09db-4f84-bb81-6d1224f64ed4", "device": "/dev/sdb"}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:05.686818 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e4d740e8-c94d-4361-bdf7-9220df66f591 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:05.687335 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e4d740e8-c94d-4361-bdf7-9220df66f591 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:05.689151 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-70585fa2-0f39-482a-9a67-edc02fff2e98 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:05.690131 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e4d740e8-c94d-4361-bdf7-9220df66f591 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:05.690608 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e4d740e8-c94d-4361-bdf7-9220df66f591 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:05.698385 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70585fa2-0f39-482a-9a67-edc02fff2e98 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:05.699188 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70585fa2-0f39-482a-9a67-edc02fff2e98 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:05.704170 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70585fa2-0f39-482a-9a67-edc02fff2e98 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:05.706803 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70585fa2-0f39-482a-9a67-edc02fff2e98 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:05.976808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e4d740e8-c94d-4361-bdf7-9220df66f591 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:05.985638 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e4d740e8-c94d-4361-bdf7-9220df66f591 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 200 len: 1318 microversion: 2.1 time: 0.316419 Jul 19 09:27:05.986206 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 151/281] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:05 2021] GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:06.026200 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d6c6932f-0ca1-4f3e-8887-aa2d530048f6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:06.027697 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d6c6932f-0ca1-4f3e-8887-aa2d530048f6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:06.037129 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d6c6932f-0ca1-4f3e-8887-aa2d530048f6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:06.037903 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d6c6932f-0ca1-4f3e-8887-aa2d530048f6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:06.039199 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d6c6932f-0ca1-4f3e-8887-aa2d530048f6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:06.039841 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d6c6932f-0ca1-4f3e-8887-aa2d530048f6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:06.116740 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-70585fa2-0f39-482a-9a67-edc02fff2e98 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "POST /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446630 Jul 19 09:27:06.135952 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 131/282] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Jul 19 09:27:05 2021] POST /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:27:06.151245 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7a482959-b445-4ced-a3b0-c8f92c89ee18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:06.152690 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7a482959-b445-4ced-a3b0-c8f92c89ee18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:06.153626 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d6c6932f-0ca1-4f3e-8887-aa2d530048f6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 33344 microversion: 2.1 time: 0.151694 Jul 19 09:27:06.158274 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 152/283] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:05 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 33344 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:06.166558 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7a482959-b445-4ced-a3b0-c8f92c89ee18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:06.168664 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7a482959-b445-4ced-a3b0-c8f92c89ee18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:06.171006 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7a482959-b445-4ced-a3b0-c8f92c89ee18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:06.172476 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7a482959-b445-4ced-a3b0-c8f92c89ee18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:06.263288 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7a482959-b445-4ced-a3b0-c8f92c89ee18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 32539 microversion: 2.20 time: 0.123692 Jul 19 09:27:06.263963 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 132/284] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:06 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 32539 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:27:06.400410 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7b142089-8ec8-4628-a13b-f1eec96ab17d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:06.401405 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7b142089-8ec8-4628-a13b-f1eec96ab17d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:06.408057 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b142089-8ec8-4628-a13b-f1eec96ab17d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:06.408579 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b142089-8ec8-4628-a13b-f1eec96ab17d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:06.409491 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b142089-8ec8-4628-a13b-f1eec96ab17d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:06.410117 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b142089-8ec8-4628-a13b-f1eec96ab17d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:06.562479 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7b142089-8ec8-4628-a13b-f1eec96ab17d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:06.570808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7b142089-8ec8-4628-a13b-f1eec96ab17d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.174480 Jul 19 09:27:06.571705 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 153/285] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:06 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:06.996064 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-a6eccbe7-2b8a-4388-8261-3874eca0f425 req-b371b7f6-7144-4db7-9270-ff79e2ed4e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648", "name": "network-vif-plugged", "status": "completed", "tag": "d9568367-e6a4-4455-8e55-2aa4ddaf098f"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:07.002378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bcd923bc-158f-4f86-bde4-d266b8f3c21a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:07.003110 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bcd923bc-158f-4f86-bde4-d266b8f3c21a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:07.008122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:27:07.008122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:27:07.017859 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bcd923bc-158f-4f86-bde4-d266b8f3c21a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:07.018299 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bcd923bc-158f-4f86-bde4-d266b8f3c21a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:07.020556 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bcd923bc-158f-4f86-bde4-d266b8f3c21a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:07.022871 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bcd923bc-158f-4f86-bde4-d266b8f3c21a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:07.027026 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-a6eccbe7-2b8a-4388-8261-3874eca0f425 req-b371b7f6-7144-4db7-9270-ff79e2ed4e59 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:07.028976 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-a6eccbe7-2b8a-4388-8261-3874eca0f425 req-b371b7f6-7144-4db7-9270-ff79e2ed4e59 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:07.056319 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-a6eccbe7-2b8a-4388-8261-3874eca0f425 req-b371b7f6-7144-4db7-9270-ff79e2ed4e59 service nova] Creating event network-vif-plugged:d9568367-e6a4-4455-8e55-2aa4ddaf098f for instance 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 on hv-cinder-79338 Jul 19 09:27:07.088915 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-a6eccbe7-2b8a-4388-8261-3874eca0f425 req-b371b7f6-7144-4db7-9270-ff79e2ed4e59 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098426 Jul 19 09:27:07.096251 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 133/286] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:27:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:27:07.172943 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3c378842-665f-43ca-b870-cab81fd690a2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:07.175352 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3c378842-665f-43ca-b870-cab81fd690a2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:07.202632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3c378842-665f-43ca-b870-cab81fd690a2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:07.203118 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3c378842-665f-43ca-b870-cab81fd690a2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:07.203947 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3c378842-665f-43ca-b870-cab81fd690a2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:07.204379 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3c378842-665f-43ca-b870-cab81fd690a2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:07.342892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3c378842-665f-43ca-b870-cab81fd690a2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 33945 microversion: 2.1 time: 0.174520 Jul 19 09:27:07.343592 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 134/287] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:07 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 33945 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:07.348849 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-76719404", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452"}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:07.413313 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.network.neutron [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] validate_networks() for None {{(pid=107464) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:27:07.418842 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bcd923bc-158f-4f86-bde4-d266b8f3c21a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:07.426896 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bcd923bc-158f-4f86-bde4-d266b8f3c21a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 200 len: 1318 microversion: 2.1 time: 0.427819 Jul 19 09:27:07.438526 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 154/288] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:06 2021] GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:07.444021 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d9521657-77cc-45b8-9b6a-557b9c3e380f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:07.445241 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d9521657-77cc-45b8-9b6a-557b9c3e380f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:07.451537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d9521657-77cc-45b8-9b6a-557b9c3e380f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:07.452078 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d9521657-77cc-45b8-9b6a-557b9c3e380f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:07.452849 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d9521657-77cc-45b8-9b6a-557b9c3e380f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:07.453280 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d9521657-77cc-45b8-9b6a-557b9c3e380f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:07.537248 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d9521657-77cc-45b8-9b6a-557b9c3e380f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 33223 microversion: 2.20 time: 0.097044 Jul 19 09:27:07.538373 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 155/289] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:07 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 33223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:27:07.588874 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3c5a7abe-6166-41a0-a9b5-aa4847751187 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:07.589485 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3c5a7abe-6166-41a0-a9b5-aa4847751187 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:07.596490 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3c5a7abe-6166-41a0-a9b5-aa4847751187 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:07.596945 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3c5a7abe-6166-41a0-a9b5-aa4847751187 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:07.598271 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3c5a7abe-6166-41a0-a9b5-aa4847751187 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:07.598932 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3c5a7abe-6166-41a0-a9b5-aa4847751187 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:07.745633 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3c5a7abe-6166-41a0-a9b5-aa4847751187 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:07.753330 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3c5a7abe-6166-41a0-a9b5-aa4847751187 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.168637 Jul 19 09:27:07.753930 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 156/290] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:07 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:08.070773 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Flavor limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:27:08.071796 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Image limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:27:08.072274 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Flavor pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:27:08.072837 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Image pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:27:08.073204 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:27:08.083394 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:08.083844 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:08.084846 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:08.085919 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:08.104784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Getting quotas for project a54885ada1574c34ad5d06b8be3f8fda. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:27:08.109301 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Getting quotas for user 0fd459f96a8b49119dca8de55d589bc8 and project a54885ada1574c34ad5d06b8be3f8fda. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:27:08.120946 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Going to run 1 instances... {{(pid=107464) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:27:08.123422 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:27:08.181949 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b0cfb2cd-2915-46c0-b8da-5cad2f0566fd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836987 Jul 19 09:27:08.183169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 135/291] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 09:27:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 09:27:08.192639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9e1c42a5-767d-44ab-b01a-dddbefc2c414 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:08.193326 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9e1c42a5-767d-44ab-b01a-dddbefc2c414 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:08.254573 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9e1c42a5-767d-44ab-b01a-dddbefc2c414 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:08.261111 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9e1c42a5-767d-44ab-b01a-dddbefc2c414 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1213 microversion: 2.1 time: 0.072085 Jul 19 09:27:08.262247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 157/292] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:08 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:08.359499 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-080bed36-22bc-4ad1-af0c-0773b20318ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:08.360545 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-080bed36-22bc-4ad1-af0c-0773b20318ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:08.378486 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-080bed36-22bc-4ad1-af0c-0773b20318ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:08.380602 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-080bed36-22bc-4ad1-af0c-0773b20318ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:08.386469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-080bed36-22bc-4ad1-af0c-0773b20318ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:08.387353 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-080bed36-22bc-4ad1-af0c-0773b20318ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:08.446654 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-89486490-ec85-4f4a-a8e3-5e44560e26bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:08.447831 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-89486490-ec85-4f4a-a8e3-5e44560e26bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:08.470678 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-89486490-ec85-4f4a-a8e3-5e44560e26bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:08.472447 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-89486490-ec85-4f4a-a8e3-5e44560e26bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:08.479574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-89486490-ec85-4f4a-a8e3-5e44560e26bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:08.480030 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-89486490-ec85-4f4a-a8e3-5e44560e26bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:08.536840 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-080bed36-22bc-4ad1-af0c-0773b20318ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 34593 microversion: 2.1 time: 0.185173 Jul 19 09:27:08.537913 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 136/293] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:08 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 34593 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:08.556417 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bf0fef2b-e4df-4922-a146-276a60bca42b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:08.557389 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bf0fef2b-e4df-4922-a146-276a60bca42b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:08.582479 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf0fef2b-e4df-4922-a146-276a60bca42b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:08.582941 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf0fef2b-e4df-4922-a146-276a60bca42b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:08.583792 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf0fef2b-e4df-4922-a146-276a60bca42b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:08.584245 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf0fef2b-e4df-4922-a146-276a60bca42b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:08.720390 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bf0fef2b-e4df-4922-a146-276a60bca42b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 33735 microversion: 2.20 time: 0.173951 Jul 19 09:27:08.721504 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 137/294] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:08 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 33735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:27:08.771241 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cc4afc7f-fdbd-44a3-bcaa-7a24ad70d7af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:08.771931 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cc4afc7f-fdbd-44a3-bcaa-7a24ad70d7af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:08.778546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc4afc7f-fdbd-44a3-bcaa-7a24ad70d7af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:08.779062 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc4afc7f-fdbd-44a3-bcaa-7a24ad70d7af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:08.779861 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc4afc7f-fdbd-44a3-bcaa-7a24ad70d7af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:08.780290 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc4afc7f-fdbd-44a3-bcaa-7a24ad70d7af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:08.864435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-89486490-ec85-4f4a-a8e3-5e44560e26bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:08.872740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-89486490-ec85-4f4a-a8e3-5e44560e26bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 200 len: 1318 microversion: 2.1 time: 0.430706 Jul 19 09:27:08.875510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 158/295] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:08 2021] GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:09.119573 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cc4afc7f-fdbd-44a3-bcaa-7a24ad70d7af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:09.130104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cc4afc7f-fdbd-44a3-bcaa-7a24ad70d7af tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.363668 Jul 19 09:27:09.130698 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 138/296] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:08 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:09.279155 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-63b85346-747b-4dff-88f3-c69b8c207cf1 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:09.280344 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-63b85346-747b-4dff-88f3-c69b8c207cf1 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:09.288626 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-63b85346-747b-4dff-88f3-c69b8c207cf1 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:09.289112 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-63b85346-747b-4dff-88f3-c69b8c207cf1 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:09.290045 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-63b85346-747b-4dff-88f3-c69b8c207cf1 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:09.290402 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-63b85346-747b-4dff-88f3-c69b8c207cf1 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:09.373654 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-63b85346-747b-4dff-88f3-c69b8c207cf1 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:09.381240 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-63b85346-747b-4dff-88f3-c69b8c207cf1 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1265 microversion: 2.1 time: 0.107293 Jul 19 09:27:09.383448 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 159/297] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:09 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:09.549201 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-151541a1-3ea9-4df5-9aa9-320031c8935e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:09.550518 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-151541a1-3ea9-4df5-9aa9-320031c8935e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:09.562972 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-151541a1-3ea9-4df5-9aa9-320031c8935e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:09.563750 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-151541a1-3ea9-4df5-9aa9-320031c8935e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:09.565012 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-151541a1-3ea9-4df5-9aa9-320031c8935e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:09.565661 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-151541a1-3ea9-4df5-9aa9-320031c8935e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:09.689262 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-151541a1-3ea9-4df5-9aa9-320031c8935e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 35303 microversion: 2.1 time: 0.144071 Jul 19 09:27:09.691989 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 139/298] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:09 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 35303 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:09.733546 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f5fa1b8e-4ad7-4457-8051-63b7ca1af7a5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:09.734947 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f5fa1b8e-4ad7-4457-8051-63b7ca1af7a5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:09.743187 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5fa1b8e-4ad7-4457-8051-63b7ca1af7a5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:09.743999 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5fa1b8e-4ad7-4457-8051-63b7ca1af7a5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:09.745064 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5fa1b8e-4ad7-4457-8051-63b7ca1af7a5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:09.745731 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5fa1b8e-4ad7-4457-8051-63b7ca1af7a5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:09.843606 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f5fa1b8e-4ad7-4457-8051-63b7ca1af7a5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 34274 microversion: 2.20 time: 0.114151 Jul 19 09:27:09.844741 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 160/299] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:09 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 34274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:27:09.892237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bd350f2c-f7a0-41db-a871-e64568264e2c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:09.893012 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bd350f2c-f7a0-41db-a871-e64568264e2c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:09.920571 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd350f2c-f7a0-41db-a871-e64568264e2c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:09.921029 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd350f2c-f7a0-41db-a871-e64568264e2c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:09.924524 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd350f2c-f7a0-41db-a871-e64568264e2c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:09.924981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd350f2c-f7a0-41db-a871-e64568264e2c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:10.148698 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9bb89c06-15b2-4265-adff-502972fa88d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:10.149317 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9bb89c06-15b2-4265-adff-502972fa88d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:10.162446 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9bb89c06-15b2-4265-adff-502972fa88d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:10.167520 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9bb89c06-15b2-4265-adff-502972fa88d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:10.168650 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9bb89c06-15b2-4265-adff-502972fa88d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:10.169274 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9bb89c06-15b2-4265-adff-502972fa88d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:10.413567 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9bb89c06-15b2-4265-adff-502972fa88d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:10.423348 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9bb89c06-15b2-4265-adff-502972fa88d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.278477 Jul 19 09:27:10.424299 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 161/300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:10 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:10.430573 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2f146cdd-b48f-4cd9-a380-3e3c45fe58dd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:10.431857 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2f146cdd-b48f-4cd9-a380-3e3c45fe58dd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:10.438385 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f146cdd-b48f-4cd9-a380-3e3c45fe58dd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:10.439705 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f146cdd-b48f-4cd9-a380-3e3c45fe58dd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:10.440905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f146cdd-b48f-4cd9-a380-3e3c45fe58dd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:10.441677 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f146cdd-b48f-4cd9-a380-3e3c45fe58dd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:10.525758 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2f146cdd-b48f-4cd9-a380-3e3c45fe58dd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:10.534754 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2f146cdd-b48f-4cd9-a380-3e3c45fe58dd tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1271 microversion: 2.1 time: 0.109255 Jul 19 09:27:10.537104 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 162/301] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:10 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:10.701930 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b6e0cfe4-849d-48f5-bb14-67de4e798640 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:10.702861 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b6e0cfe4-849d-48f5-bb14-67de4e798640 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:10.711913 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6e0cfe4-849d-48f5-bb14-67de4e798640 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:10.712621 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6e0cfe4-849d-48f5-bb14-67de4e798640 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:10.713574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6e0cfe4-849d-48f5-bb14-67de4e798640 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:10.714194 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6e0cfe4-849d-48f5-bb14-67de4e798640 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:10.796096 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bd350f2c-f7a0-41db-a871-e64568264e2c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:10.808958 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bd350f2c-f7a0-41db-a871-e64568264e2c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 200 len: 1508 microversion: 2.1 time: 0.920577 Jul 19 09:27:10.811011 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 140/302] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:09 2021] GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 1508 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:10.812886 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b6e0cfe4-849d-48f5-bb14-67de4e798640 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 36000 microversion: 2.1 time: 0.114423 Jul 19 09:27:10.814120 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 163/303] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:10 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 36000 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:10.835847 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-dddefaea-22ef-49c7-93ab-3b8fcc787cba tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f55443b-89e8-48d9-98ba-2b7769d03953"}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:10.837781 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-dddefaea-22ef-49c7-93ab-3b8fcc787cba tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:10.846183 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dddefaea-22ef-49c7-93ab-3b8fcc787cba tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:10.846951 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dddefaea-22ef-49c7-93ab-3b8fcc787cba tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:10.848736 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dddefaea-22ef-49c7-93ab-3b8fcc787cba tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:10.849372 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dddefaea-22ef-49c7-93ab-3b8fcc787cba tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:10.859826 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f5f51fe9-533f-4298-aac0-e123a05e7e80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:10.860829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f5f51fe9-533f-4298-aac0-e123a05e7e80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:10.876102 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5f51fe9-533f-4298-aac0-e123a05e7e80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:10.876886 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5f51fe9-533f-4298-aac0-e123a05e7e80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:10.880503 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5f51fe9-533f-4298-aac0-e123a05e7e80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:10.882749 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5f51fe9-533f-4298-aac0-e123a05e7e80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:10.976689 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-dddefaea-22ef-49c7-93ab-3b8fcc787cba tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] HTTP exception thrown: Invalid volume: volume 2f55443b-89e8-48d9-98ba-2b7769d03953 is already attached to instances: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f Jul 19 09:27:10.977507 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-dddefaea-22ef-49c7-93ab-3b8fcc787cba tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Returning 400 to user: Invalid volume: volume 2f55443b-89e8-48d9-98ba-2b7769d03953 is already attached to instances: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:27:10.978669 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-dddefaea-22ef-49c7-93ab-3b8fcc787cba tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "POST /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.152472 Jul 19 09:27:10.979878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 141/304] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Jul 19 09:27:10 2021] POST /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648/os-volume_attachments => generated 174 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 09:27:10.999455 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f5f51fe9-533f-4298-aac0-e123a05e7e80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 34956 microversion: 2.20 time: 0.144732 Jul 19 09:27:11.005937 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 164/305] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:10 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 34956 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:27:11.078052 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-084b9d21-3869-4430-bfff-fdb524465dca tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:11.078548 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-084b9d21-3869-4430-bfff-fdb524465dca tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:11.086822 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-084b9d21-3869-4430-bfff-fdb524465dca tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:11.087543 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-084b9d21-3869-4430-bfff-fdb524465dca tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:11.088541 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-084b9d21-3869-4430-bfff-fdb524465dca tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:11.089297 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-084b9d21-3869-4430-bfff-fdb524465dca tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:11.223107 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.objects.instance [None req-084b9d21-3869-4430-bfff-fdb524465dca tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lazy-loading 'services' on Instance uuid d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f {{(pid=107464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:27:11.443760 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b322d91a-b67b-4049-a6d0-1cee5dfc6c02 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:11.445221 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b322d91a-b67b-4049-a6d0-1cee5dfc6c02 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:11.451664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b322d91a-b67b-4049-a6d0-1cee5dfc6c02 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:11.452370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b322d91a-b67b-4049-a6d0-1cee5dfc6c02 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:11.453324 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b322d91a-b67b-4049-a6d0-1cee5dfc6c02 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:11.453767 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b322d91a-b67b-4049-a6d0-1cee5dfc6c02 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:11.523766 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-084b9d21-3869-4430-bfff-fdb524465dca tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f/os-volume_attachments/2f55443b-89e8-48d9-98ba-2b7769d03953" status: 202 len: 0 microversion: 2.1 time: 0.449256 Jul 19 09:27:11.538310 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 142/306] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Jul 19 09:27:11 2021] DELETE /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f/os-volume_attachments/2f55443b-89e8-48d9-98ba-2b7769d03953 => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:27:11.564175 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9cb43e20-dc9a-4a9e-8f85-f0e54938ab66 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:11.567945 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9cb43e20-dc9a-4a9e-8f85-f0e54938ab66 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:11.597205 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9cb43e20-dc9a-4a9e-8f85-f0e54938ab66 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:11.598240 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9cb43e20-dc9a-4a9e-8f85-f0e54938ab66 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:11.602052 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9cb43e20-dc9a-4a9e-8f85-f0e54938ab66 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:11.602505 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9cb43e20-dc9a-4a9e-8f85-f0e54938ab66 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:11.742610 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b322d91a-b67b-4049-a6d0-1cee5dfc6c02 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:11.761802 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b322d91a-b67b-4049-a6d0-1cee5dfc6c02 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.323412 Jul 19 09:27:11.762523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 165/307] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:11 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:11.787168 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9cb43e20-dc9a-4a9e-8f85-f0e54938ab66 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:11.795820 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9cb43e20-dc9a-4a9e-8f85-f0e54938ab66 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1271 microversion: 2.1 time: 0.243118 Jul 19 09:27:11.796436 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 143/308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:11 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1271 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:11.836454 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c21a13a2-385c-4704-982d-5f7692d3544e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:11.838630 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c21a13a2-385c-4704-982d-5f7692d3544e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:11.853417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c21a13a2-385c-4704-982d-5f7692d3544e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:11.853978 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c21a13a2-385c-4704-982d-5f7692d3544e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:11.854905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c21a13a2-385c-4704-982d-5f7692d3544e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:11.855457 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c21a13a2-385c-4704-982d-5f7692d3544e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:11.956535 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c21a13a2-385c-4704-982d-5f7692d3544e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 36453 microversion: 2.1 time: 0.134611 Jul 19 09:27:11.962247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 166/309] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:11 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 36453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:12.012342 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e0476f43-0cf5-486f-ad88-ab8053fd96d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:12.014198 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e0476f43-0cf5-486f-ad88-ab8053fd96d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:12.023477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e0476f43-0cf5-486f-ad88-ab8053fd96d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:12.024122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e0476f43-0cf5-486f-ad88-ab8053fd96d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:12.025412 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e0476f43-0cf5-486f-ad88-ab8053fd96d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:12.031133 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e0476f43-0cf5-486f-ad88-ab8053fd96d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:12.146456 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e0476f43-0cf5-486f-ad88-ab8053fd96d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 35397 microversion: 2.20 time: 0.137300 Jul 19 09:27:12.151483 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 144/310] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:12 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 35397 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:27:12.780490 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5fe09633-9d7d-4e2e-8edf-ff31410661b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:12.782490 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5fe09633-9d7d-4e2e-8edf-ff31410661b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:12.814449 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c8ddc564-4307-4521-b62e-0b2f6feafd9f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:12.815786 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c8ddc564-4307-4521-b62e-0b2f6feafd9f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:12.821811 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5fe09633-9d7d-4e2e-8edf-ff31410661b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:12.822549 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5fe09633-9d7d-4e2e-8edf-ff31410661b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:12.823593 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5fe09633-9d7d-4e2e-8edf-ff31410661b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:12.824412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5fe09633-9d7d-4e2e-8edf-ff31410661b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:12.826349 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c8ddc564-4307-4521-b62e-0b2f6feafd9f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:12.830293 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c8ddc564-4307-4521-b62e-0b2f6feafd9f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:12.831625 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c8ddc564-4307-4521-b62e-0b2f6feafd9f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:12.835671 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c8ddc564-4307-4521-b62e-0b2f6feafd9f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:13.095389 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5fe09633-9d7d-4e2e-8edf-ff31410661b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:13.115586 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5fe09633-9d7d-4e2e-8edf-ff31410661b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.331140 Jul 19 09:27:13.116934 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 167/311] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:12 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:13.132184 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-714d1ade-4456-49de-a3e2-e13d776acc68 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:13.133334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-714d1ade-4456-49de-a3e2-e13d776acc68 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:13.141559 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-714d1ade-4456-49de-a3e2-e13d776acc68 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:13.142331 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-714d1ade-4456-49de-a3e2-e13d776acc68 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:13.148628 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-714d1ade-4456-49de-a3e2-e13d776acc68 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:13.149552 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-714d1ade-4456-49de-a3e2-e13d776acc68 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:13.162714 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c8ddc564-4307-4521-b62e-0b2f6feafd9f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:13.174239 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c8ddc564-4307-4521-b62e-0b2f6feafd9f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1313 microversion: 2.1 time: 0.363471 Jul 19 09:27:13.175418 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 145/312] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:12 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:13.180306 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-428c22c3-2fd7-4174-a458-f4b95ac39266 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:13.187003 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-428c22c3-2fd7-4174-a458-f4b95ac39266 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:13.193731 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-428c22c3-2fd7-4174-a458-f4b95ac39266 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:13.194935 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-428c22c3-2fd7-4174-a458-f4b95ac39266 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:13.195781 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-428c22c3-2fd7-4174-a458-f4b95ac39266 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:13.196285 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-428c22c3-2fd7-4174-a458-f4b95ac39266 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:13.351466 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-714d1ade-4456-49de-a3e2-e13d776acc68 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 36957 microversion: 2.1 time: 0.232949 Jul 19 09:27:13.352130 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 168/313] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:13 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 36957 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:13.371846 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-428c22c3-2fd7-4174-a458-f4b95ac39266 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 35908 microversion: 2.20 time: 0.194363 Jul 19 09:27:13.374744 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 146/314] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:13 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 35908 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:27:13.379353 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-86180b52-13a6-400d-a442-56531088a6c1 req-5cfb190f-d3a3-463b-a0a9-a543592fabf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d15c4b-d521-4bd3-9fa3-fb58ce655bc7", "tag": "8a59df2b-0df2-4f0d-a574-189011bc73a8"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:13.382795 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:27:13.382795 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:27:13.395806 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-86180b52-13a6-400d-a442-56531088a6c1 req-5cfb190f-d3a3-463b-a0a9-a543592fabf4 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:13.396885 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-86180b52-13a6-400d-a442-56531088a6c1 req-5cfb190f-d3a3-463b-a0a9-a543592fabf4 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:13.411138 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-86180b52-13a6-400d-a442-56531088a6c1 req-5cfb190f-d3a3-463b-a0a9-a543592fabf4 service nova] Creating event network-changed:8a59df2b-0df2-4f0d-a574-189011bc73a8 for instance 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 on hv-cinder-79338 Jul 19 09:27:13.416650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-86180b52-13a6-400d-a442-56531088a6c1 req-5cfb190f-d3a3-463b-a0a9-a543592fabf4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042531 Jul 19 09:27:13.418478 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 147/315] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:27:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:27:13.563511 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8434d194-d5d9-4b69-9c99-5226bc50bf8e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Action: 'create', calling method: .version_select at 0x7f04b04065e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-260386788"}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:13.583014 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-8434d194-d5d9-4b69-9c99-5226bc50bf8e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Getting quotas for project 9d2bfe61cc3e4e789667d6a0ac2792a9. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:27:13.587314 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-8434d194-d5d9-4b69-9c99-5226bc50bf8e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Getting quotas for user a447ab1e5e9a4660b457e639d7e96339 and project 9d2bfe61cc3e4e789667d6a0ac2792a9. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:27:13.704838 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-8434d194-d5d9-4b69-9c99-5226bc50bf8e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Getting quotas for project 9d2bfe61cc3e4e789667d6a0ac2792a9. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:27:13.709526 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-8434d194-d5d9-4b69-9c99-5226bc50bf8e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Getting quotas for user a447ab1e5e9a4660b457e639d7e96339 and project 9d2bfe61cc3e4e789667d6a0ac2792a9. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:27:13.724133 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8434d194-d5d9-4b69-9c99-5226bc50bf8e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.370624 Jul 19 09:27:13.724900 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 169/316] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jul 19 09:27:13 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:14.134409 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8f379dda-2217-49a4-ac0d-d20fabfc7f4d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:14.140650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8f379dda-2217-49a4-ac0d-d20fabfc7f4d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:14.162945 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8f379dda-2217-49a4-ac0d-d20fabfc7f4d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:14.163771 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8f379dda-2217-49a4-ac0d-d20fabfc7f4d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:14.165169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8f379dda-2217-49a4-ac0d-d20fabfc7f4d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:14.165813 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8f379dda-2217-49a4-ac0d-d20fabfc7f4d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:14.197900 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b29972d1-cfd3-4324-98c8-c73bea452ab4 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:14.199784 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b29972d1-cfd3-4324-98c8-c73bea452ab4 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:14.213376 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b29972d1-cfd3-4324-98c8-c73bea452ab4 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:14.214017 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b29972d1-cfd3-4324-98c8-c73bea452ab4 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:14.215275 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b29972d1-cfd3-4324-98c8-c73bea452ab4 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:14.216829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b29972d1-cfd3-4324-98c8-c73bea452ab4 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:14.471992 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b29972d1-cfd3-4324-98c8-c73bea452ab4 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:14.485000 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b29972d1-cfd3-4324-98c8-c73bea452ab4 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1313 microversion: 2.1 time: 0.297194 Jul 19 09:27:14.485713 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 170/317] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:14 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:14.492660 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-edfd433b-6036-49f6-bd32-d1c27535127c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:14.493894 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-edfd433b-6036-49f6-bd32-d1c27535127c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:14.501225 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-edfd433b-6036-49f6-bd32-d1c27535127c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:14.501999 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-edfd433b-6036-49f6-bd32-d1c27535127c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:14.502859 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-edfd433b-6036-49f6-bd32-d1c27535127c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:14.503514 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-edfd433b-6036-49f6-bd32-d1c27535127c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:14.507722 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8f379dda-2217-49a4-ac0d-d20fabfc7f4d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:14.517480 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8f379dda-2217-49a4-ac0d-d20fabfc7f4d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.386396 Jul 19 09:27:14.523114 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 148/318] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:14 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:14.529969 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8ba3cec2-7024-468d-a6ad-a7e4440ad9a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:14.531339 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8ba3cec2-7024-468d-a6ad-a7e4440ad9a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:14.541127 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8ba3cec2-7024-468d-a6ad-a7e4440ad9a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:14.541718 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8ba3cec2-7024-468d-a6ad-a7e4440ad9a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:14.543153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8ba3cec2-7024-468d-a6ad-a7e4440ad9a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:14.543664 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8ba3cec2-7024-468d-a6ad-a7e4440ad9a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:14.621756 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-edfd433b-6036-49f6-bd32-d1c27535127c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 37621 microversion: 2.1 time: 0.134141 Jul 19 09:27:14.622410 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 171/319] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:14 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 37621 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:14.640524 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8ba3cec2-7024-468d-a6ad-a7e4440ad9a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 36618 microversion: 2.20 time: 0.114900 Jul 19 09:27:14.641563 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 149/320] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:14 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 36618 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:27:14.991442 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-838893444", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452", "networks": [{"uuid": "ffe762f0-68bd-4db8-b328-c8e2b8fc1624"}]}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:15.089213 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.network.neutron [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] validate_networks() for [('ffe762f0-68bd-4db8-b328-c8e2b8fc1624', None, None, None)] {{(pid=107463) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:27:15.501969 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-730dd287-fd5e-48b8-bdc7-366a0cc36d40 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:15.508775 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-730dd287-fd5e-48b8-bdc7-366a0cc36d40 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:15.515898 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-730dd287-fd5e-48b8-bdc7-366a0cc36d40 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:15.516600 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-730dd287-fd5e-48b8-bdc7-366a0cc36d40 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:15.517603 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-730dd287-fd5e-48b8-bdc7-366a0cc36d40 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:15.518051 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-730dd287-fd5e-48b8-bdc7-366a0cc36d40 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:15.550293 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Flavor limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:27:15.550813 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Image limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:27:15.551329 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Flavor pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:27:15.551740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Image pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:27:15.552160 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:27:15.562231 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:15.562781 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:15.563977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:15.564553 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:15.584790 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Getting quotas for project 4427b775629d442d9448281ff5171b24. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:27:15.590042 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Getting quotas for user 6b45b7dbaf5c41a998a64ef62132ea6d and project 4427b775629d442d9448281ff5171b24. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:27:15.603748 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Going to run 1 instances... {{(pid=107463) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:27:15.608380 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:27:15.666313 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bb291d48-4c59-422a-921c-a1d4374dbfb9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679495 Jul 19 09:27:15.667557 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 172/321] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 09:27:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 09:27:15.677313 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-37eff004-e94b-41cd-968c-3b4c04c00f29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:15.678037 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-37eff004-e94b-41cd-968c-3b4c04c00f29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:15.684596 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37eff004-e94b-41cd-968c-3b4c04c00f29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:15.685529 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37eff004-e94b-41cd-968c-3b4c04c00f29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:15.686648 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37eff004-e94b-41cd-968c-3b4c04c00f29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:15.687526 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37eff004-e94b-41cd-968c-3b4c04c00f29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:15.731606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-730dd287-fd5e-48b8-bdc7-366a0cc36d40 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:15.739104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-730dd287-fd5e-48b8-bdc7-366a0cc36d40 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1313 microversion: 2.1 time: 0.241061 Jul 19 09:27:15.752244 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 150/322] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:15 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:15.774031 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5979aa0a-a907-499d-a240-0cbdaceb4d83 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:15.778619 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5979aa0a-a907-499d-a240-0cbdaceb4d83 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:15.817552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5979aa0a-a907-499d-a240-0cbdaceb4d83 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:15.818009 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5979aa0a-a907-499d-a240-0cbdaceb4d83 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:15.818826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5979aa0a-a907-499d-a240-0cbdaceb4d83 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:15.819276 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5979aa0a-a907-499d-a240-0cbdaceb4d83 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:15.939686 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-37eff004-e94b-41cd-968c-3b4c04c00f29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:15.948867 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-37eff004-e94b-41cd-968c-3b4c04c00f29 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.274527 Jul 19 09:27:15.968302 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 173/323] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:15 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:15.973915 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f4fbb9d4-bd12-4c61-a218-f4cb501fa0e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:15.975680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f4fbb9d4-bd12-4c61-a218-f4cb501fa0e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:15.985591 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4fbb9d4-bd12-4c61-a218-f4cb501fa0e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:15.986254 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4fbb9d4-bd12-4c61-a218-f4cb501fa0e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:15.987262 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4fbb9d4-bd12-4c61-a218-f4cb501fa0e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:15.988412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4fbb9d4-bd12-4c61-a218-f4cb501fa0e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:17.723616 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5979aa0a-a907-499d-a240-0cbdaceb4d83 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 38126 microversion: 2.1 time: 1.978272 Jul 19 09:27:17.724153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 151/324] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:15 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 38126 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:17.732127 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3a5634c9-4dfa-4709-b850-9a507962961e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:17.733167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3a5634c9-4dfa-4709-b850-9a507962961e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:17.740143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3a5634c9-4dfa-4709-b850-9a507962961e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:17.741009 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3a5634c9-4dfa-4709-b850-9a507962961e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:17.741882 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3a5634c9-4dfa-4709-b850-9a507962961e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:17.742420 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3a5634c9-4dfa-4709-b850-9a507962961e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:17.749353 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f4fbb9d4-bd12-4c61-a218-f4cb501fa0e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 38115 microversion: 2.20 time: 1.779336 Jul 19 09:27:17.753622 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 174/325] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:15 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 38115 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:27:17.755687 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8d0ee2ac-6848-47a7-9e24-e912dc93e567 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:17.756380 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8d0ee2ac-6848-47a7-9e24-e912dc93e567 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:17.767795 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d0ee2ac-6848-47a7-9e24-e912dc93e567 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:17.768558 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d0ee2ac-6848-47a7-9e24-e912dc93e567 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:17.769576 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d0ee2ac-6848-47a7-9e24-e912dc93e567 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:17.770190 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d0ee2ac-6848-47a7-9e24-e912dc93e567 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:17.845816 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3a5634c9-4dfa-4709-b850-9a507962961e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:17.854546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3a5634c9-4dfa-4709-b850-9a507962961e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1221 microversion: 2.1 time: 0.128707 Jul 19 09:27:17.855837 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 152/326] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:17 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1221 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:17.861470 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b1d0b846-bb38-4c81-ba82-6a091b3cc107 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:17.862360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b1d0b846-bb38-4c81-ba82-6a091b3cc107 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:17.871684 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1d0b846-bb38-4c81-ba82-6a091b3cc107 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:17.872790 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1d0b846-bb38-4c81-ba82-6a091b3cc107 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:17.873810 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1d0b846-bb38-4c81-ba82-6a091b3cc107 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:17.874456 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1d0b846-bb38-4c81-ba82-6a091b3cc107 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:17.958827 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8d0ee2ac-6848-47a7-9e24-e912dc93e567 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:17.966855 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8d0ee2ac-6848-47a7-9e24-e912dc93e567 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1313 microversion: 2.1 time: 0.215384 Jul 19 09:27:17.976312 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 175/327] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:17 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:18.093767 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b1d0b846-bb38-4c81-ba82-6a091b3cc107 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:18.101972 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b1d0b846-bb38-4c81-ba82-6a091b3cc107 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.244833 Jul 19 09:27:18.106483 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 153/328] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:17 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:18.735972 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4300c16f-de9b-4f3d-9292-69ec741dbab9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:18.736926 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4300c16f-de9b-4f3d-9292-69ec741dbab9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:18.742931 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4300c16f-de9b-4f3d-9292-69ec741dbab9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:18.743422 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4300c16f-de9b-4f3d-9292-69ec741dbab9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:18.744195 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4300c16f-de9b-4f3d-9292-69ec741dbab9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:18.744630 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4300c16f-de9b-4f3d-9292-69ec741dbab9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:18.762344 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cf72a098-1af6-4a06-af51-50b3348d0c02 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:18.763676 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cf72a098-1af6-4a06-af51-50b3348d0c02 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:18.770628 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cf72a098-1af6-4a06-af51-50b3348d0c02 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:18.771185 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cf72a098-1af6-4a06-af51-50b3348d0c02 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:18.771966 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cf72a098-1af6-4a06-af51-50b3348d0c02 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:18.772517 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cf72a098-1af6-4a06-af51-50b3348d0c02 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:18.828102 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4300c16f-de9b-4f3d-9292-69ec741dbab9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 38126 microversion: 2.1 time: 0.095660 Jul 19 09:27:18.828883 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 176/329] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:18 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 38126 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:18.872296 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4ce7aee2-afc0-4bb1-ba8d-fbaf5699e78e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:18.872955 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4ce7aee2-afc0-4bb1-ba8d-fbaf5699e78e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:18.876438 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cf72a098-1af6-4a06-af51-50b3348d0c02 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 38118 microversion: 2.20 time: 0.118751 Jul 19 09:27:18.877972 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 154/330] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:18 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 38118 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:27:18.880561 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4ce7aee2-afc0-4bb1-ba8d-fbaf5699e78e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:18.881115 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4ce7aee2-afc0-4bb1-ba8d-fbaf5699e78e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:18.882116 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4ce7aee2-afc0-4bb1-ba8d-fbaf5699e78e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:18.882685 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4ce7aee2-afc0-4bb1-ba8d-fbaf5699e78e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:18.954409 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4ce7aee2-afc0-4bb1-ba8d-fbaf5699e78e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:18.962034 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4ce7aee2-afc0-4bb1-ba8d-fbaf5699e78e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1275 microversion: 2.1 time: 0.093727 Jul 19 09:27:18.971871 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 177/331] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:18 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:18.984960 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b76d4d63-1191-4811-896e-ca16ca9fa97f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:18.985895 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b76d4d63-1191-4811-896e-ca16ca9fa97f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:18.993859 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b76d4d63-1191-4811-896e-ca16ca9fa97f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:18.994428 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b76d4d63-1191-4811-896e-ca16ca9fa97f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:18.995470 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b76d4d63-1191-4811-896e-ca16ca9fa97f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:18.996110 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b76d4d63-1191-4811-896e-ca16ca9fa97f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:19.119568 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-01ec998d-aca7-4daf-94ac-6bb73faa8f20 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:19.120181 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-01ec998d-aca7-4daf-94ac-6bb73faa8f20 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:19.125818 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-01ec998d-aca7-4daf-94ac-6bb73faa8f20 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:19.126266 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-01ec998d-aca7-4daf-94ac-6bb73faa8f20 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:19.127341 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-01ec998d-aca7-4daf-94ac-6bb73faa8f20 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:19.127777 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-01ec998d-aca7-4daf-94ac-6bb73faa8f20 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:19.230866 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b76d4d63-1191-4811-896e-ca16ca9fa97f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:19.238816 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b76d4d63-1191-4811-896e-ca16ca9fa97f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1313 microversion: 2.1 time: 0.258436 Jul 19 09:27:19.244852 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 155/332] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:18 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:19.266822 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-01ec998d-aca7-4daf-94ac-6bb73faa8f20 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:19.274302 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-01ec998d-aca7-4daf-94ac-6bb73faa8f20 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.158648 Jul 19 09:27:19.282870 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 178/333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:19 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:19.840757 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-febcfeb4-7f4a-425a-8893-2beb64e3421e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:19.841595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-febcfeb4-7f4a-425a-8893-2beb64e3421e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:19.848097 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-febcfeb4-7f4a-425a-8893-2beb64e3421e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:19.848550 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-febcfeb4-7f4a-425a-8893-2beb64e3421e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:19.849314 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-febcfeb4-7f4a-425a-8893-2beb64e3421e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:19.849748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-febcfeb4-7f4a-425a-8893-2beb64e3421e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:19.888424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3942efc9-5da6-469a-a529-962841f3102d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:19.889334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3942efc9-5da6-469a-a529-962841f3102d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:19.896468 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3942efc9-5da6-469a-a529-962841f3102d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:19.897018 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3942efc9-5da6-469a-a529-962841f3102d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:19.897889 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3942efc9-5da6-469a-a529-962841f3102d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:19.898337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3942efc9-5da6-469a-a529-962841f3102d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:22.218041 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-febcfeb4-7f4a-425a-8893-2beb64e3421e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 200 len: 38255 microversion: 2.1 time: 2.380761 Jul 19 09:27:22.218630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 156/334] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:19 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 38255 bytes in 2382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:22.225861 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3942efc9-5da6-469a-a529-962841f3102d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 200 len: 38257 microversion: 2.20 time: 2.340917 Jul 19 09:27:22.231551 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 179/335] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:19 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 38257 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:27:22.231727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2e87be0a-200f-43dc-8736-c0e49325f1a8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:22.231727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2e87be0a-200f-43dc-8736-c0e49325f1a8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:22.232697 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-338f732c-096f-4d61-8549-7a5421a5f25c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:22.233752 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-338f732c-096f-4d61-8549-7a5421a5f25c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:22.240252 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-338f732c-096f-4d61-8549-7a5421a5f25c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:22.240949 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-338f732c-096f-4d61-8549-7a5421a5f25c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:22.241722 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-338f732c-096f-4d61-8549-7a5421a5f25c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:22.242320 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-338f732c-096f-4d61-8549-7a5421a5f25c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:22.245955 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2e87be0a-200f-43dc-8736-c0e49325f1a8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:22.246415 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2e87be0a-200f-43dc-8736-c0e49325f1a8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:22.247237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2e87be0a-200f-43dc-8736-c0e49325f1a8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:22.247684 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2e87be0a-200f-43dc-8736-c0e49325f1a8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:22.400622 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-338f732c-096f-4d61-8549-7a5421a5f25c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:22.408199 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-338f732c-096f-4d61-8549-7a5421a5f25c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1313 microversion: 2.1 time: 0.179999 Jul 19 09:27:22.408759 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 180/336] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:22 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:22.414440 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b75ac5a8-0808-4832-8cc6-492fb561e3a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:22.415283 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b75ac5a8-0808-4832-8cc6-492fb561e3a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:22.421243 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b75ac5a8-0808-4832-8cc6-492fb561e3a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:22.421689 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b75ac5a8-0808-4832-8cc6-492fb561e3a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:22.422449 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b75ac5a8-0808-4832-8cc6-492fb561e3a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:22.423006 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b75ac5a8-0808-4832-8cc6-492fb561e3a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:22.476721 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2e87be0a-200f-43dc-8736-c0e49325f1a8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:22.485160 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2e87be0a-200f-43dc-8736-c0e49325f1a8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1317 microversion: 2.1 time: 0.259759 Jul 19 09:27:22.486061 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 157/337] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:22 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:22.492345 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-926bbd9f-9bad-458c-bbea-4f649f5a07df req-d6da5434-67f5-41e1-9ab2-90d0e098a000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "249757f0-2b91-4c45-b523-d9514051420c", "tag": "af17d36c-1a1f-47d3-bece-1254af6bef7d"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:22.494535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:27:22.494535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:27:22.502244 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-926bbd9f-9bad-458c-bbea-4f649f5a07df req-d6da5434-67f5-41e1-9ab2-90d0e098a000 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:22.502928 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-926bbd9f-9bad-458c-bbea-4f649f5a07df req-d6da5434-67f5-41e1-9ab2-90d0e098a000 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:22.516289 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-926bbd9f-9bad-458c-bbea-4f649f5a07df req-d6da5434-67f5-41e1-9ab2-90d0e098a000 service nova] Creating event network-changed:af17d36c-1a1f-47d3-bece-1254af6bef7d for instance 249757f0-2b91-4c45-b523-d9514051420c on hv-cinder-79338 Jul 19 09:27:22.522664 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-926bbd9f-9bad-458c-bbea-4f649f5a07df req-d6da5434-67f5-41e1-9ab2-90d0e098a000 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035154 Jul 19 09:27:22.523861 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 158/338] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:27:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:27:22.529602 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d236e2cf-737c-4309-b5fd-c741cf99aa0d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:22.530475 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d236e2cf-737c-4309-b5fd-c741cf99aa0d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:22.537885 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d236e2cf-737c-4309-b5fd-c741cf99aa0d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:22.538302 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d236e2cf-737c-4309-b5fd-c741cf99aa0d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:22.539172 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d236e2cf-737c-4309-b5fd-c741cf99aa0d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:22.539692 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d236e2cf-737c-4309-b5fd-c741cf99aa0d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:22.563539 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d236e2cf-737c-4309-b5fd-c741cf99aa0d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/ips" status: 200 len: 145 microversion: 2.1 time: 0.038076 Jul 19 09:27:22.564122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 159/339] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Jul 19 09:27:22 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:27:22.567383 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b75ac5a8-0808-4832-8cc6-492fb561e3a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:22.569087 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c830f2e2-4aa7-4fd2-afa3-110965e9a6ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:22.569582 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c830f2e2-4aa7-4fd2-afa3-110965e9a6ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:22.575329 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c830f2e2-4aa7-4fd2-afa3-110965e9a6ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:22.575784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c830f2e2-4aa7-4fd2-afa3-110965e9a6ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:22.576555 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c830f2e2-4aa7-4fd2-afa3-110965e9a6ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:22.576988 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c830f2e2-4aa7-4fd2-afa3-110965e9a6ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:22.582549 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b75ac5a8-0808-4832-8cc6-492fb561e3a9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.172233 Jul 19 09:27:22.583471 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 181/340] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:22 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:22.602434 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c830f2e2-4aa7-4fd2-afa3-110965e9a6ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/ips" status: 200 len: 151 microversion: 2.20 time: 0.037273 Jul 19 09:27:22.602992 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 160/341] 10.222.0.16 () {60 vars in 1289 bytes} [Mon Jul 19 09:27:22 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:27:23.424981 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-20523da3-a38a-4179-830d-09b6a803d35b tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:23.426223 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-20523da3-a38a-4179-830d-09b6a803d35b tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:23.432294 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-20523da3-a38a-4179-830d-09b6a803d35b tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:23.432736 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-20523da3-a38a-4179-830d-09b6a803d35b tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:23.433519 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-20523da3-a38a-4179-830d-09b6a803d35b tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:23.433947 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-20523da3-a38a-4179-830d-09b6a803d35b tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:23.501543 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-50039a8e-95b1-41c9-af2e-6a6d357e73bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:23.502144 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-50039a8e-95b1-41c9-af2e-6a6d357e73bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:23.508697 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50039a8e-95b1-41c9-af2e-6a6d357e73bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:23.509171 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50039a8e-95b1-41c9-af2e-6a6d357e73bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:23.509938 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50039a8e-95b1-41c9-af2e-6a6d357e73bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:23.510370 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50039a8e-95b1-41c9-af2e-6a6d357e73bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:23.570668 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-20523da3-a38a-4179-830d-09b6a803d35b tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:23.577975 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-20523da3-a38a-4179-830d-09b6a803d35b tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1313 microversion: 2.1 time: 0.156630 Jul 19 09:27:23.578533 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 182/342] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:23 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:23.599786 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f2a9189f-623b-48a3-80ee-c67c4b7fb884 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:23.600463 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f2a9189f-623b-48a3-80ee-c67c4b7fb884 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:23.606395 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2a9189f-623b-48a3-80ee-c67c4b7fb884 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:23.606847 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2a9189f-623b-48a3-80ee-c67c4b7fb884 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:23.607644 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2a9189f-623b-48a3-80ee-c67c4b7fb884 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:23.608085 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2a9189f-623b-48a3-80ee-c67c4b7fb884 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:23.650539 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-50039a8e-95b1-41c9-af2e-6a6d357e73bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:23.657912 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-50039a8e-95b1-41c9-af2e-6a6d357e73bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1317 microversion: 2.1 time: 0.160010 Jul 19 09:27:23.658470 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 161/343] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:23 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:23.743292 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f2a9189f-623b-48a3-80ee-c67c4b7fb884 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:23.750387 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f2a9189f-623b-48a3-80ee-c67c4b7fb884 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.155168 Jul 19 09:27:23.750942 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 183/344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:23 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:24.594887 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-00197b8e-3d4c-4a4b-9ac1-d5abefbd7bed tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:24.595547 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-00197b8e-3d4c-4a4b-9ac1-d5abefbd7bed tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:24.601947 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-00197b8e-3d4c-4a4b-9ac1-d5abefbd7bed tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:24.602391 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-00197b8e-3d4c-4a4b-9ac1-d5abefbd7bed tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:24.603194 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-00197b8e-3d4c-4a4b-9ac1-d5abefbd7bed tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:24.603630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-00197b8e-3d4c-4a4b-9ac1-d5abefbd7bed tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:24.676031 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4cdb1d24-6455-4509-8172-3ec30d2d2513 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:24.676647 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4cdb1d24-6455-4509-8172-3ec30d2d2513 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:24.682374 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4cdb1d24-6455-4509-8172-3ec30d2d2513 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:24.682824 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4cdb1d24-6455-4509-8172-3ec30d2d2513 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:24.683632 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4cdb1d24-6455-4509-8172-3ec30d2d2513 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:24.684067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4cdb1d24-6455-4509-8172-3ec30d2d2513 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:24.741720 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-00197b8e-3d4c-4a4b-9ac1-d5abefbd7bed tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:24.748952 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-00197b8e-3d4c-4a4b-9ac1-d5abefbd7bed tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1313 microversion: 2.1 time: 0.157756 Jul 19 09:27:24.749512 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 162/345] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:24 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:24.766469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-518b5349-6b37-4830-9796-655dd2c34d7d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:24.767104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-518b5349-6b37-4830-9796-655dd2c34d7d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:24.772802 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-518b5349-6b37-4830-9796-655dd2c34d7d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:24.773250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-518b5349-6b37-4830-9796-655dd2c34d7d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:24.774099 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-518b5349-6b37-4830-9796-655dd2c34d7d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:24.774671 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-518b5349-6b37-4830-9796-655dd2c34d7d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:24.821969 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4cdb1d24-6455-4509-8172-3ec30d2d2513 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:24.831247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4cdb1d24-6455-4509-8172-3ec30d2d2513 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1317 microversion: 2.1 time: 0.159592 Jul 19 09:27:24.832544 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 184/346] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:24 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:24.912898 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-518b5349-6b37-4830-9796-655dd2c34d7d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:24.920899 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-518b5349-6b37-4830-9796-655dd2c34d7d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.157885 Jul 19 09:27:24.921468 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 163/347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:24 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:25.764804 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-535744f1-686e-4f55-ae32-48a52247f9da tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:25.765420 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-535744f1-686e-4f55-ae32-48a52247f9da tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:25.772379 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-535744f1-686e-4f55-ae32-48a52247f9da tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:25.772829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-535744f1-686e-4f55-ae32-48a52247f9da tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:25.773613 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-535744f1-686e-4f55-ae32-48a52247f9da tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:25.774051 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-535744f1-686e-4f55-ae32-48a52247f9da tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:25.848995 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0c63bdb9-922f-4c76-aa6c-7ac3d9ac1485 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:25.849602 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0c63bdb9-922f-4c76-aa6c-7ac3d9ac1485 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:25.856271 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c63bdb9-922f-4c76-aa6c-7ac3d9ac1485 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:25.856811 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c63bdb9-922f-4c76-aa6c-7ac3d9ac1485 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:25.857797 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c63bdb9-922f-4c76-aa6c-7ac3d9ac1485 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:25.858324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c63bdb9-922f-4c76-aa6c-7ac3d9ac1485 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:25.910622 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-535744f1-686e-4f55-ae32-48a52247f9da tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:25.918183 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-535744f1-686e-4f55-ae32-48a52247f9da tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1313 microversion: 2.1 time: 0.157096 Jul 19 09:27:25.918734 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 185/348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:25 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:25.937303 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9f549731-d633-412c-bd55-8ae55f025222 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:25.938355 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9f549731-d633-412c-bd55-8ae55f025222 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:25.943634 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f549731-d633-412c-bd55-8ae55f025222 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:25.944085 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f549731-d633-412c-bd55-8ae55f025222 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:25.944849 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f549731-d633-412c-bd55-8ae55f025222 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:25.945283 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f549731-d633-412c-bd55-8ae55f025222 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:25.998209 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0c63bdb9-922f-4c76-aa6c-7ac3d9ac1485 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:26.005505 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0c63bdb9-922f-4c76-aa6c-7ac3d9ac1485 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1317 microversion: 2.1 time: 0.160834 Jul 19 09:27:26.006066 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 164/349] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:25 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:26.077995 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9f549731-d633-412c-bd55-8ae55f025222 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:26.085833 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9f549731-d633-412c-bd55-8ae55f025222 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.152096 Jul 19 09:27:26.086387 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 186/350] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:25 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:26.934546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-02895cbf-d38a-43fc-8d0a-5865ba4fd106 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:26.935208 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-02895cbf-d38a-43fc-8d0a-5865ba4fd106 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:26.941611 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-02895cbf-d38a-43fc-8d0a-5865ba4fd106 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:26.942060 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-02895cbf-d38a-43fc-8d0a-5865ba4fd106 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:26.942818 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-02895cbf-d38a-43fc-8d0a-5865ba4fd106 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:26.943292 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-02895cbf-d38a-43fc-8d0a-5865ba4fd106 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:27.023495 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-67e84cec-4d55-4ef9-ab8e-2590d454798d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:27.024589 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-67e84cec-4d55-4ef9-ab8e-2590d454798d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:27.032912 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67e84cec-4d55-4ef9-ab8e-2590d454798d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:27.033364 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67e84cec-4d55-4ef9-ab8e-2590d454798d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:27.034966 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67e84cec-4d55-4ef9-ab8e-2590d454798d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:27.035325 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67e84cec-4d55-4ef9-ab8e-2590d454798d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:27.116358 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-02895cbf-d38a-43fc-8d0a-5865ba4fd106 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:27.125903 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-02895cbf-d38a-43fc-8d0a-5865ba4fd106 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1313 microversion: 2.1 time: 0.194649 Jul 19 09:27:27.140738 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 165/351] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:26 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:27.145971 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b5e8ede5-3851-4bbd-b4bc-65f6c2cc688d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:27.146592 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b5e8ede5-3851-4bbd-b4bc-65f6c2cc688d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:27.170037 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b5e8ede5-3851-4bbd-b4bc-65f6c2cc688d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:27.170517 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b5e8ede5-3851-4bbd-b4bc-65f6c2cc688d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:27.171358 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b5e8ede5-3851-4bbd-b4bc-65f6c2cc688d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:27.174730 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b5e8ede5-3851-4bbd-b4bc-65f6c2cc688d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:27.217360 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-67e84cec-4d55-4ef9-ab8e-2590d454798d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:27.229078 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-67e84cec-4d55-4ef9-ab8e-2590d454798d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1317 microversion: 2.1 time: 0.209237 Jul 19 09:27:27.230088 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 187/352] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:27 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:27.351499 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b5e8ede5-3851-4bbd-b4bc-65f6c2cc688d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:27.366178 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b5e8ede5-3851-4bbd-b4bc-65f6c2cc688d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.220039 Jul 19 09:27:27.366178 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 166/353] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:27 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:28.141789 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e9b74a71-6a2b-48c8-bae4-cc274933d87c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:28.142397 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e9b74a71-6a2b-48c8-bae4-cc274933d87c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:28.148134 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9b74a71-6a2b-48c8-bae4-cc274933d87c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:28.148582 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9b74a71-6a2b-48c8-bae4-cc274933d87c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:28.149350 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9b74a71-6a2b-48c8-bae4-cc274933d87c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:28.149785 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9b74a71-6a2b-48c8-bae4-cc274933d87c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:28.246797 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5b72c98f-2440-4734-9811-68c0764f70a3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:28.247631 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5b72c98f-2440-4734-9811-68c0764f70a3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:28.254344 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5b72c98f-2440-4734-9811-68c0764f70a3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:28.254790 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5b72c98f-2440-4734-9811-68c0764f70a3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:28.255591 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5b72c98f-2440-4734-9811-68c0764f70a3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:28.256057 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5b72c98f-2440-4734-9811-68c0764f70a3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:28.285946 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e9b74a71-6a2b-48c8-bae4-cc274933d87c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:28.294351 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e9b74a71-6a2b-48c8-bae4-cc274933d87c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1313 microversion: 2.1 time: 0.156150 Jul 19 09:27:28.295483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 188/354] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:28 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:28.384120 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e7a7c285-55f0-4eeb-a380-8925d5852ca4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:28.384732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e7a7c285-55f0-4eeb-a380-8925d5852ca4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:28.391973 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e7a7c285-55f0-4eeb-a380-8925d5852ca4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:28.392439 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e7a7c285-55f0-4eeb-a380-8925d5852ca4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:28.393756 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e7a7c285-55f0-4eeb-a380-8925d5852ca4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:28.394198 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e7a7c285-55f0-4eeb-a380-8925d5852ca4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:28.399155 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5b72c98f-2440-4734-9811-68c0764f70a3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:28.406224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5b72c98f-2440-4734-9811-68c0764f70a3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1317 microversion: 2.1 time: 0.163188 Jul 19 09:27:28.406785 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 167/355] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:28 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:28.463454 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-44e2f805-233d-4fe4-be50-9735f128e3e5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:28.464136 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-44e2f805-233d-4fe4-be50-9735f128e3e5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:28.470680 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44e2f805-233d-4fe4-be50-9735f128e3e5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:28.471328 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44e2f805-233d-4fe4-be50-9735f128e3e5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:28.472705 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44e2f805-233d-4fe4-be50-9735f128e3e5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:28.473247 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44e2f805-233d-4fe4-be50-9735f128e3e5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:28.513805 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.objects.instance [None req-44e2f805-233d-4fe4-be50-9735f128e3e5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lazy-loading 'flavor' on Instance uuid 5cbcf278-5d96-4715-9238-5dd27d17311d {{(pid=107464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:27:28.542197 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e7a7c285-55f0-4eeb-a380-8925d5852ca4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:28.549595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e7a7c285-55f0-4eeb-a380-8925d5852ca4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.169868 Jul 19 09:27:28.551119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 189/356] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:28 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:28.556238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5c16f5fe-c246-4c62-9ac7-3ce365bfb497 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad029823-3e41-4c95-a380-9bb327fbbff5"}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:28.557643 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5c16f5fe-c246-4c62-9ac7-3ce365bfb497 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:28.563742 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5c16f5fe-c246-4c62-9ac7-3ce365bfb497 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:28.564195 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5c16f5fe-c246-4c62-9ac7-3ce365bfb497 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:28.564977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5c16f5fe-c246-4c62-9ac7-3ce365bfb497 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:28.565414 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5c16f5fe-c246-4c62-9ac7-3ce365bfb497 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:28.858498 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5c16f5fe-c246-4c62-9ac7-3ce365bfb497 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305933 Jul 19 09:27:28.859223 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 190/357] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Jul 19 09:27:28 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:27:29.312053 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b9c75342-1d4d-4015-b93a-0ef4aeea2ed2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:29.312754 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b9c75342-1d4d-4015-b93a-0ef4aeea2ed2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:29.319183 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9c75342-1d4d-4015-b93a-0ef4aeea2ed2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:29.319635 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9c75342-1d4d-4015-b93a-0ef4aeea2ed2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:29.320543 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9c75342-1d4d-4015-b93a-0ef4aeea2ed2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:29.320826 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9c75342-1d4d-4015-b93a-0ef4aeea2ed2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:29.365768 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-44e2f805-233d-4fe4-be50-9735f128e3e5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 202 len: 0 microversion: 2.20 time: 0.906230 Jul 19 09:27:29.366674 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 168/358] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:27:28 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 0 bytes in 908 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 19 09:27:29.375108 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ac5b3cfb-d52c-4181-87bf-15bfaeb35029 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:29.375802 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ac5b3cfb-d52c-4181-87bf-15bfaeb35029 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:29.382552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ac5b3cfb-d52c-4181-87bf-15bfaeb35029 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:29.383003 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ac5b3cfb-d52c-4181-87bf-15bfaeb35029 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:29.383877 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ac5b3cfb-d52c-4181-87bf-15bfaeb35029 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:29.384320 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ac5b3cfb-d52c-4181-87bf-15bfaeb35029 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:29.460766 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b9c75342-1d4d-4015-b93a-0ef4aeea2ed2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:29.468522 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b9c75342-1d4d-4015-b93a-0ef4aeea2ed2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1313 microversion: 2.1 time: 0.160463 Jul 19 09:27:29.471130 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 191/359] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:29 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:29.478171 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2be367a7-e6e0-4fa5-9f06-cb167117f196 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:29.478966 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2be367a7-e6e0-4fa5-9f06-cb167117f196 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:29.485324 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2be367a7-e6e0-4fa5-9f06-cb167117f196 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:29.486025 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2be367a7-e6e0-4fa5-9f06-cb167117f196 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:29.486986 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2be367a7-e6e0-4fa5-9f06-cb167117f196 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:29.488152 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2be367a7-e6e0-4fa5-9f06-cb167117f196 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:29.539286 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ac5b3cfb-d52c-4181-87bf-15bfaeb35029 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:29.547266 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ac5b3cfb-d52c-4181-87bf-15bfaeb35029 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:29.548782 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ac5b3cfb-d52c-4181-87bf-15bfaeb35029 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:29.550431 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ac5b3cfb-d52c-4181-87bf-15bfaeb35029 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.178880 Jul 19 09:27:29.550981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 169/360] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:29 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:27:29.566569 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8fa731ae-308b-4f54-93a1-7a4231bf8b53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:29.567204 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8fa731ae-308b-4f54-93a1-7a4231bf8b53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:29.572939 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8fa731ae-308b-4f54-93a1-7a4231bf8b53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:29.573414 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8fa731ae-308b-4f54-93a1-7a4231bf8b53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:29.574176 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8fa731ae-308b-4f54-93a1-7a4231bf8b53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:29.574618 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8fa731ae-308b-4f54-93a1-7a4231bf8b53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:29.627499 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2be367a7-e6e0-4fa5-9f06-cb167117f196 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:29.635094 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2be367a7-e6e0-4fa5-9f06-cb167117f196 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1317 microversion: 2.1 time: 0.161545 Jul 19 09:27:29.635693 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 192/361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:29 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:29.706636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8fa731ae-308b-4f54-93a1-7a4231bf8b53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:29.714164 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8fa731ae-308b-4f54-93a1-7a4231bf8b53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.151206 Jul 19 09:27:29.714751 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 170/362] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:29 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:30.485992 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-09213041-eb27-47d5-b170-55451d599eea tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:30.486755 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-09213041-eb27-47d5-b170-55451d599eea tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:30.493373 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09213041-eb27-47d5-b170-55451d599eea tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:30.493844 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09213041-eb27-47d5-b170-55451d599eea tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:30.494664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09213041-eb27-47d5-b170-55451d599eea tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:30.495024 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09213041-eb27-47d5-b170-55451d599eea tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:30.569536 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5ec9b712-aafd-4ce6-bfb8-9075ae9c2a36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:30.570147 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5ec9b712-aafd-4ce6-bfb8-9075ae9c2a36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:30.580077 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ec9b712-aafd-4ce6-bfb8-9075ae9c2a36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:30.585110 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ec9b712-aafd-4ce6-bfb8-9075ae9c2a36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:30.586546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ec9b712-aafd-4ce6-bfb8-9075ae9c2a36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:30.587191 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ec9b712-aafd-4ce6-bfb8-9075ae9c2a36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:30.663555 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-09213041-eb27-47d5-b170-55451d599eea tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:30.671985 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-09213041-eb27-47d5-b170-55451d599eea tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1313 microversion: 2.1 time: 0.189941 Jul 19 09:27:30.681877 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 193/363] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:30 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:30.684944 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-44cd726b-6475-40c9-a821-6d0a3edab7f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:30.685622 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-44cd726b-6475-40c9-a821-6d0a3edab7f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:30.692238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44cd726b-6475-40c9-a821-6d0a3edab7f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:30.692692 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44cd726b-6475-40c9-a821-6d0a3edab7f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:30.693668 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44cd726b-6475-40c9-a821-6d0a3edab7f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:30.694261 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44cd726b-6475-40c9-a821-6d0a3edab7f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:30.761574 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5ec9b712-aafd-4ce6-bfb8-9075ae9c2a36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:30.770699 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5ec9b712-aafd-4ce6-bfb8-9075ae9c2a36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:30.772274 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5ec9b712-aafd-4ce6-bfb8-9075ae9c2a36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:30.773410 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5ec9b712-aafd-4ce6-bfb8-9075ae9c2a36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.208193 Jul 19 09:27:30.774343 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 171/364] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:30 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:27:30.779433 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-2cf7f581-3d13-4e53-af2d-6e79b2572474 req-bee8bdbc-d702-4236-ae30-7e2751b74e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d15c4b-d521-4bd3-9fa3-fb58ce655bc7", "name": "network-vif-plugged", "status": "completed", "tag": "8a59df2b-0df2-4f0d-a574-189011bc73a8"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:30.782129 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:27:30.782129 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:27:30.790719 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-2cf7f581-3d13-4e53-af2d-6e79b2572474 req-bee8bdbc-d702-4236-ae30-7e2751b74e4e service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:30.791180 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-2cf7f581-3d13-4e53-af2d-6e79b2572474 req-bee8bdbc-d702-4236-ae30-7e2751b74e4e service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:30.802386 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-2cf7f581-3d13-4e53-af2d-6e79b2572474 req-bee8bdbc-d702-4236-ae30-7e2751b74e4e service nova] Creating event network-vif-plugged:8a59df2b-0df2-4f0d-a574-189011bc73a8 for instance 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 on hv-cinder-79338 Jul 19 09:27:30.807142 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-2cf7f581-3d13-4e53-af2d-6e79b2572474 req-bee8bdbc-d702-4236-ae30-7e2751b74e4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031682 Jul 19 09:27:30.807953 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 172/365] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:27:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:27:30.813974 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4ddbb04d-89f9-452b-86e7-2d6748f5b3f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:30.814675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4ddbb04d-89f9-452b-86e7-2d6748f5b3f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:30.821417 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4ddbb04d-89f9-452b-86e7-2d6748f5b3f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:30.821884 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4ddbb04d-89f9-452b-86e7-2d6748f5b3f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:30.822676 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4ddbb04d-89f9-452b-86e7-2d6748f5b3f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:30.823148 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4ddbb04d-89f9-452b-86e7-2d6748f5b3f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:30.844990 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-44cd726b-6475-40c9-a821-6d0a3edab7f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:30.852639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-44cd726b-6475-40c9-a821-6d0a3edab7f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1317 microversion: 2.1 time: 0.171802 Jul 19 09:27:30.853286 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 194/366] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:30 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:30.966270 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4ddbb04d-89f9-452b-86e7-2d6748f5b3f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:30.973726 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4ddbb04d-89f9-452b-86e7-2d6748f5b3f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.163677 Jul 19 09:27:30.974289 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 173/367] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:30 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:31.242696 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-735c411b-0e54-4acf-895b-2cf9def054d9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:31.243214 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-735c411b-0e54-4acf-895b-2cf9def054d9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:31.248795 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-735c411b-0e54-4acf-895b-2cf9def054d9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:31.249233 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-735c411b-0e54-4acf-895b-2cf9def054d9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:31.249991 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-735c411b-0e54-4acf-895b-2cf9def054d9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:31.250412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-735c411b-0e54-4acf-895b-2cf9def054d9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:31.382934 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.objects.instance [None req-735c411b-0e54-4acf-895b-2cf9def054d9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lazy-loading 'services' on Instance uuid c39f0be4-c55f-4e6c-bccf-be5be1e02919 {{(pid=107463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:27:31.494970 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-735c411b-0e54-4acf-895b-2cf9def054d9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919/os-volume_attachments/2c2669ca-09db-4f84-bb81-6d1224f64ed4" status: 202 len: 0 microversion: 2.1 time: 0.255616 Jul 19 09:27:31.495632 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 195/368] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Jul 19 09:27:31 2021] DELETE /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919/os-volume_attachments/2c2669ca-09db-4f84-bb81-6d1224f64ed4 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:27:31.689959 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ef189d67-8382-4b34-b9eb-6222bd0fc0c2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:31.690827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ef189d67-8382-4b34-b9eb-6222bd0fc0c2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:31.696813 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ef189d67-8382-4b34-b9eb-6222bd0fc0c2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:31.697271 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ef189d67-8382-4b34-b9eb-6222bd0fc0c2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:31.698056 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ef189d67-8382-4b34-b9eb-6222bd0fc0c2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:31.698641 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ef189d67-8382-4b34-b9eb-6222bd0fc0c2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:31.793858 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-12935b08-3849-48a0-977d-b5ca1b9d69c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:31.794571 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-12935b08-3849-48a0-977d-b5ca1b9d69c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:31.801397 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12935b08-3849-48a0-977d-b5ca1b9d69c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:31.801848 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12935b08-3849-48a0-977d-b5ca1b9d69c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:31.802632 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12935b08-3849-48a0-977d-b5ca1b9d69c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:31.803081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12935b08-3849-48a0-977d-b5ca1b9d69c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:31.902218 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ef189d67-8382-4b34-b9eb-6222bd0fc0c2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:31.909678 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ef189d67-8382-4b34-b9eb-6222bd0fc0c2 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1313 microversion: 2.1 time: 0.223845 Jul 19 09:27:31.917083 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 174/369] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:31 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:31.917083 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6417b9f9-d00d-41ff-8903-ed13451db4ee tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:31.917083 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6417b9f9-d00d-41ff-8903-ed13451db4ee tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:31.922720 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6417b9f9-d00d-41ff-8903-ed13451db4ee tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:31.923201 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6417b9f9-d00d-41ff-8903-ed13451db4ee tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:31.923978 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6417b9f9-d00d-41ff-8903-ed13451db4ee tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:31.924407 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6417b9f9-d00d-41ff-8903-ed13451db4ee tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:31.947985 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-12935b08-3849-48a0-977d-b5ca1b9d69c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:31.955490 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-12935b08-3849-48a0-977d-b5ca1b9d69c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:31.957027 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-12935b08-3849-48a0-977d-b5ca1b9d69c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:31.958663 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-12935b08-3849-48a0-977d-b5ca1b9d69c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.169344 Jul 19 09:27:31.959240 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 196/370] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:31 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:27:31.990967 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b7fb2278-61f1-45c2-ab1c-6ad55f6d5951 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:31.991865 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b7fb2278-61f1-45c2-ab1c-6ad55f6d5951 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:31.997920 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7fb2278-61f1-45c2-ab1c-6ad55f6d5951 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:31.998465 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7fb2278-61f1-45c2-ab1c-6ad55f6d5951 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:31.999319 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7fb2278-61f1-45c2-ab1c-6ad55f6d5951 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:31.999841 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7fb2278-61f1-45c2-ab1c-6ad55f6d5951 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:32.199482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6417b9f9-d00d-41ff-8903-ed13451db4ee tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:32.209285 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6417b9f9-d00d-41ff-8903-ed13451db4ee tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1317 microversion: 2.1 time: 0.297301 Jul 19 09:27:32.209985 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b7fb2278-61f1-45c2-ab1c-6ad55f6d5951 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:32.210438 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 175/371] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:31 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:32.224221 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b7fb2278-61f1-45c2-ab1c-6ad55f6d5951 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.237007 Jul 19 09:27:32.224995 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 197/372] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:31 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:32.820814 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-3a94ca98-1c29-4e5e-b131-186b2572ef7d req-ad2a84f1-8d56-4201-9fb6-05fd66066cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "249757f0-2b91-4c45-b523-d9514051420c", "name": "network-vif-plugged", "status": "completed", "tag": "af17d36c-1a1f-47d3-bece-1254af6bef7d"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:32.822385 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:27:32.822385 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:27:32.830420 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-3a94ca98-1c29-4e5e-b131-186b2572ef7d req-ad2a84f1-8d56-4201-9fb6-05fd66066cbf service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:32.830847 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-3a94ca98-1c29-4e5e-b131-186b2572ef7d req-ad2a84f1-8d56-4201-9fb6-05fd66066cbf service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:32.841252 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-3a94ca98-1c29-4e5e-b131-186b2572ef7d req-ad2a84f1-8d56-4201-9fb6-05fd66066cbf service nova] Creating event network-vif-plugged:af17d36c-1a1f-47d3-bece-1254af6bef7d for instance 249757f0-2b91-4c45-b523-d9514051420c on hv-cinder-79338 Jul 19 09:27:32.845948 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-3a94ca98-1c29-4e5e-b131-186b2572ef7d req-ad2a84f1-8d56-4201-9fb6-05fd66066cbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028756 Jul 19 09:27:32.846613 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 176/373] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:27:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:27:32.930899 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2aca9c6d-794d-44d8-9cde-e7ae14a74d00 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:32.931586 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2aca9c6d-794d-44d8-9cde-e7ae14a74d00 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:32.938179 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2aca9c6d-794d-44d8-9cde-e7ae14a74d00 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:32.938608 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2aca9c6d-794d-44d8-9cde-e7ae14a74d00 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:32.939582 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2aca9c6d-794d-44d8-9cde-e7ae14a74d00 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:32.940054 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2aca9c6d-794d-44d8-9cde-e7ae14a74d00 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:32.985346 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-74317c2c-e442-4c05-9159-d67984ceb369 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:32.986150 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-74317c2c-e442-4c05-9159-d67984ceb369 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:32.993075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-74317c2c-e442-4c05-9159-d67984ceb369 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:32.993600 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-74317c2c-e442-4c05-9159-d67984ceb369 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:32.994447 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-74317c2c-e442-4c05-9159-d67984ceb369 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:32.994982 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-74317c2c-e442-4c05-9159-d67984ceb369 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:33.088937 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2aca9c6d-794d-44d8-9cde-e7ae14a74d00 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:33.096197 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2aca9c6d-794d-44d8-9cde-e7ae14a74d00 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1463 microversion: 2.1 time: 0.173416 Jul 19 09:27:33.096764 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 198/374] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:32 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1463 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:33.134042 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6193e97f-2a5b-4504-8714-8875474abd91 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:33.134599 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6193e97f-2a5b-4504-8714-8875474abd91 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:33.144454 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6193e97f-2a5b-4504-8714-8875474abd91 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:33.144994 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6193e97f-2a5b-4504-8714-8875474abd91 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:33.145993 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6193e97f-2a5b-4504-8714-8875474abd91 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:33.146512 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6193e97f-2a5b-4504-8714-8875474abd91 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:33.179371 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6193e97f-2a5b-4504-8714-8875474abd91 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Going to try to terminate instance {{(pid=107463) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:27:33.205772 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-74317c2c-e442-4c05-9159-d67984ceb369 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:33.214011 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-74317c2c-e442-4c05-9159-d67984ceb369 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:33.215706 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-74317c2c-e442-4c05-9159-d67984ceb369 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:33.216977 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-74317c2c-e442-4c05-9159-d67984ceb369 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.240693 Jul 19 09:27:33.217713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 177/375] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:32 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:27:33.225735 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8051a9c1-82c8-45ef-9a1f-ed09e7e47144 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:33.226407 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8051a9c1-82c8-45ef-9a1f-ed09e7e47144 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:33.232020 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8051a9c1-82c8-45ef-9a1f-ed09e7e47144 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:33.232470 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8051a9c1-82c8-45ef-9a1f-ed09e7e47144 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:33.233228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8051a9c1-82c8-45ef-9a1f-ed09e7e47144 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:33.233638 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8051a9c1-82c8-45ef-9a1f-ed09e7e47144 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:33.268334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6193e97f-2a5b-4504-8714-8875474abd91 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "DELETE /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 204 len: 0 microversion: 2.1 time: 0.137573 Jul 19 09:27:33.269029 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 199/376] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:27:33 2021] DELETE /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 09:27:33.275191 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2af9ff58-8ad1-4cf5-b3aa-9096cbfdfeef tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:33.275889 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2af9ff58-8ad1-4cf5-b3aa-9096cbfdfeef tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:33.281857 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2af9ff58-8ad1-4cf5-b3aa-9096cbfdfeef tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:33.282514 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2af9ff58-8ad1-4cf5-b3aa-9096cbfdfeef tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:33.283412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2af9ff58-8ad1-4cf5-b3aa-9096cbfdfeef tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:33.283848 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2af9ff58-8ad1-4cf5-b3aa-9096cbfdfeef tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:33.387901 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8051a9c1-82c8-45ef-9a1f-ed09e7e47144 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:33.395834 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8051a9c1-82c8-45ef-9a1f-ed09e7e47144 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1317 microversion: 2.1 time: 0.173976 Jul 19 09:27:33.396495 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 178/377] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:33 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:33.400870 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-86930131-fba1-4a73-8ac4-b88ac8bc3094 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:33.401538 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-86930131-fba1-4a73-8ac4-b88ac8bc3094 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:33.409504 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86930131-fba1-4a73-8ac4-b88ac8bc3094 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:33.409952 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86930131-fba1-4a73-8ac4-b88ac8bc3094 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:33.410728 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86930131-fba1-4a73-8ac4-b88ac8bc3094 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:33.411187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86930131-fba1-4a73-8ac4-b88ac8bc3094 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:33.428426 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2af9ff58-8ad1-4cf5-b3aa-9096cbfdfeef tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:33.436973 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2af9ff58-8ad1-4cf5-b3aa-9096cbfdfeef tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.165920 Jul 19 09:27:33.437723 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 200/378] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:33 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:33.544141 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-86930131-fba1-4a73-8ac4-b88ac8bc3094 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:33.552060 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-86930131-fba1-4a73-8ac4-b88ac8bc3094 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1469 microversion: 2.1 time: 0.154042 Jul 19 09:27:33.552625 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 179/379] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:33 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:34.235895 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-650f7d4a-a948-46e9-b8d1-dee74c8e6556 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:34.236507 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-650f7d4a-a948-46e9-b8d1-dee74c8e6556 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:34.242779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-650f7d4a-a948-46e9-b8d1-dee74c8e6556 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:34.243274 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-650f7d4a-a948-46e9-b8d1-dee74c8e6556 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:34.244041 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-650f7d4a-a948-46e9-b8d1-dee74c8e6556 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:34.244479 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-650f7d4a-a948-46e9-b8d1-dee74c8e6556 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:34.381809 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-650f7d4a-a948-46e9-b8d1-dee74c8e6556 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:34.389474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-650f7d4a-a948-46e9-b8d1-dee74c8e6556 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:34.390987 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-650f7d4a-a948-46e9-b8d1-dee74c8e6556 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:34.392172 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-650f7d4a-a948-46e9-b8d1-dee74c8e6556 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.159990 Jul 19 09:27:34.392725 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 201/380] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:34 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:27:34.412658 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-abb60f40-3f49-4aad-8244-e926c147650f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:34.413295 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-abb60f40-3f49-4aad-8244-e926c147650f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:34.419341 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-abb60f40-3f49-4aad-8244-e926c147650f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:34.419772 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-abb60f40-3f49-4aad-8244-e926c147650f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:34.420534 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-abb60f40-3f49-4aad-8244-e926c147650f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:34.420967 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-abb60f40-3f49-4aad-8244-e926c147650f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:34.453747 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7af863ed-cac4-4a5c-b447-900454f46bba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:34.454275 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7af863ed-cac4-4a5c-b447-900454f46bba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:34.460147 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7af863ed-cac4-4a5c-b447-900454f46bba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:34.460596 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7af863ed-cac4-4a5c-b447-900454f46bba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:34.461360 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7af863ed-cac4-4a5c-b447-900454f46bba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:34.461801 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7af863ed-cac4-4a5c-b447-900454f46bba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:34.605072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7af863ed-cac4-4a5c-b447-900454f46bba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:34.612717 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7af863ed-cac4-4a5c-b447-900454f46bba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.162600 Jul 19 09:27:34.613339 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 202/381] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:34 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:34.618249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-48f4ce1e-f223-4012-966f-d1d41354826d tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:34.618862 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-48f4ce1e-f223-4012-966f-d1d41354826d tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:34.624977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-48f4ce1e-f223-4012-966f-d1d41354826d tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:34.625427 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-48f4ce1e-f223-4012-966f-d1d41354826d tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:34.626212 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-48f4ce1e-f223-4012-966f-d1d41354826d tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:34.626647 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-48f4ce1e-f223-4012-966f-d1d41354826d tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:34.765496 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-48f4ce1e-f223-4012-966f-d1d41354826d tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:34.772769 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-abb60f40-3f49-4aad-8244-e926c147650f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:34.773769 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-48f4ce1e-f223-4012-966f-d1d41354826d tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1469 microversion: 2.1 time: 0.158822 Jul 19 09:27:34.774596 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 203/382] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:34 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:34.780360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-abb60f40-3f49-4aad-8244-e926c147650f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1317 microversion: 2.1 time: 0.371823 Jul 19 09:27:34.781813 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 180/383] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:34 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:35.409532 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7398b473-0c28-48dd-a589-00a653fd36c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:35.410051 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7398b473-0c28-48dd-a589-00a653fd36c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:35.415814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7398b473-0c28-48dd-a589-00a653fd36c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:35.416264 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7398b473-0c28-48dd-a589-00a653fd36c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:35.417297 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7398b473-0c28-48dd-a589-00a653fd36c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:35.417797 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7398b473-0c28-48dd-a589-00a653fd36c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:35.552935 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7398b473-0c28-48dd-a589-00a653fd36c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:35.560643 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7398b473-0c28-48dd-a589-00a653fd36c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:35.562144 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7398b473-0c28-48dd-a589-00a653fd36c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:35.563289 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7398b473-0c28-48dd-a589-00a653fd36c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.157535 Jul 19 09:27:35.563842 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 204/384] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:35 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:27:35.630097 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0e415678-737e-4a86-83dc-954eb702a389 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:35.630713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0e415678-737e-4a86-83dc-954eb702a389 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:35.636506 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0e415678-737e-4a86-83dc-954eb702a389 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:35.636960 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0e415678-737e-4a86-83dc-954eb702a389 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:35.637730 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0e415678-737e-4a86-83dc-954eb702a389 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:35.638169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0e415678-737e-4a86-83dc-954eb702a389 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:35.769560 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0e415678-737e-4a86-83dc-954eb702a389 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:35.776779 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0e415678-737e-4a86-83dc-954eb702a389 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.150847 Jul 19 09:27:35.777914 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 181/385] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:35 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:35.792409 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-401e7c4e-5cf9-48a3-9194-6facaf3a4c3f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:35.792409 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-401e7c4e-5cf9-48a3-9194-6facaf3a4c3f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:35.796846 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-401e7c4e-5cf9-48a3-9194-6facaf3a4c3f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:35.797288 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-401e7c4e-5cf9-48a3-9194-6facaf3a4c3f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:35.797412 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-40a5be9d-538d-4070-aea9-36fcaa13c54c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:35.798046 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-401e7c4e-5cf9-48a3-9194-6facaf3a4c3f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:35.798155 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-40a5be9d-538d-4070-aea9-36fcaa13c54c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:35.798473 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-401e7c4e-5cf9-48a3-9194-6facaf3a4c3f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:35.804233 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-40a5be9d-538d-4070-aea9-36fcaa13c54c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:35.804681 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-40a5be9d-538d-4070-aea9-36fcaa13c54c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:35.805444 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-40a5be9d-538d-4070-aea9-36fcaa13c54c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:35.805882 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-40a5be9d-538d-4070-aea9-36fcaa13c54c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:35.949892 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-401e7c4e-5cf9-48a3-9194-6facaf3a4c3f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:35.951011 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-40a5be9d-538d-4070-aea9-36fcaa13c54c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:35.957337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-401e7c4e-5cf9-48a3-9194-6facaf3a4c3f tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1469 microversion: 2.1 time: 0.171074 Jul 19 09:27:35.958017 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 205/386] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:35 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1469 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:35.958261 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-40a5be9d-538d-4070-aea9-36fcaa13c54c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1506 microversion: 2.1 time: 0.164359 Jul 19 09:27:35.958818 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 182/387] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:35 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:36.581835 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cc58a4b1-31ad-4850-b3e4-891b17200548 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:36.582436 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-cc58a4b1-31ad-4850-b3e4-891b17200548 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:36.588581 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc58a4b1-31ad-4850-b3e4-891b17200548 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:36.589031 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc58a4b1-31ad-4850-b3e4-891b17200548 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:36.589793 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc58a4b1-31ad-4850-b3e4-891b17200548 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:36.590227 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc58a4b1-31ad-4850-b3e4-891b17200548 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:36.734236 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cc58a4b1-31ad-4850-b3e4-891b17200548 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:36.741887 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cc58a4b1-31ad-4850-b3e4-891b17200548 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:36.743410 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cc58a4b1-31ad-4850-b3e4-891b17200548 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:36.744532 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-cc58a4b1-31ad-4850-b3e4-891b17200548 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.166765 Jul 19 09:27:36.745088 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 206/388] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:36 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:27:36.793209 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-387fc402-9c33-4ad2-883b-ca87613370d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:36.793791 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-387fc402-9c33-4ad2-883b-ca87613370d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:36.799476 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-387fc402-9c33-4ad2-883b-ca87613370d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:36.799921 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-387fc402-9c33-4ad2-883b-ca87613370d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:36.800682 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-387fc402-9c33-4ad2-883b-ca87613370d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:36.801115 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-387fc402-9c33-4ad2-883b-ca87613370d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:36.933564 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-387fc402-9c33-4ad2-883b-ca87613370d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:36.940790 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-387fc402-9c33-4ad2-883b-ca87613370d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1523 microversion: 2.1 time: 0.151520 Jul 19 09:27:36.941322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 183/389] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:36 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:36.973386 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0b0fe79a-3caf-45f7-9bc8-183ed301356c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:36.974013 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0b0fe79a-3caf-45f7-9bc8-183ed301356c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:36.980109 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0b0fe79a-3caf-45f7-9bc8-183ed301356c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:36.980550 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0b0fe79a-3caf-45f7-9bc8-183ed301356c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:36.981298 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0b0fe79a-3caf-45f7-9bc8-183ed301356c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:36.981725 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0b0fe79a-3caf-45f7-9bc8-183ed301356c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:37.114707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0b0fe79a-3caf-45f7-9bc8-183ed301356c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:37.122051 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0b0fe79a-3caf-45f7-9bc8-183ed301356c tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1469 microversion: 2.1 time: 0.152252 Jul 19 09:27:37.122819 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 207/390] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:36 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:37.272996 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-be1c483e-7849-4ac6-8b4d-a1d178bbb8ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a29cd883-a371-41fc-a3e9-551d0331958d"}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:37.274122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-be1c483e-7849-4ac6-8b4d-a1d178bbb8ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:37.279856 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be1c483e-7849-4ac6-8b4d-a1d178bbb8ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:37.280305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be1c483e-7849-4ac6-8b4d-a1d178bbb8ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:37.281066 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be1c483e-7849-4ac6-8b4d-a1d178bbb8ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:37.281503 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be1c483e-7849-4ac6-8b4d-a1d178bbb8ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:37.406813 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-133d6ee8-6aa1-4364-8935-14c5f3f5fc39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:37.413165 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-133d6ee8-6aa1-4364-8935-14c5f3f5fc39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:37.413685 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-133d6ee8-6aa1-4364-8935-14c5f3f5fc39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:37.495098 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-133d6ee8-6aa1-4364-8935-14c5f3f5fc39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Going to try to stop instance {{(pid=107463) force_stop /opt/stack/nova/nova/compute/api.py:2582}} Jul 19 09:27:37.548706 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-133d6ee8-6aa1-4364-8935-14c5f3f5fc39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 202 len: 0 microversion: 2.1 time: 0.145248 Jul 19 09:27:37.549814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 208/391] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:37 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:27:37.558530 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-be1c483e-7849-4ac6-8b4d-a1d178bbb8ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "POST /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288431 Jul 19 09:27:37.559151 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1b813f22-2957-48f9-8884-8d3aeedb096d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:37.559565 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 184/392] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Jul 19 09:27:37 2021] POST /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:27:37.560121 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1b813f22-2957-48f9-8884-8d3aeedb096d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:37.569429 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b813f22-2957-48f9-8884-8d3aeedb096d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:37.569849 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b813f22-2957-48f9-8884-8d3aeedb096d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:37.570763 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b813f22-2957-48f9-8884-8d3aeedb096d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:37.571242 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b813f22-2957-48f9-8884-8d3aeedb096d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:37.718715 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1b813f22-2957-48f9-8884-8d3aeedb096d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:37.731400 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1b813f22-2957-48f9-8884-8d3aeedb096d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.176838 Jul 19 09:27:37.731980 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 209/393] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:37 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:37.763535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ede2014f-a4ef-4f2f-a7ed-e56053c243c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:37.764370 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ede2014f-a4ef-4f2f-a7ed-e56053c243c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:37.770316 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ede2014f-a4ef-4f2f-a7ed-e56053c243c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:37.770765 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ede2014f-a4ef-4f2f-a7ed-e56053c243c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:37.771562 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ede2014f-a4ef-4f2f-a7ed-e56053c243c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:37.772000 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ede2014f-a4ef-4f2f-a7ed-e56053c243c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:37.958939 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7d4d9efd-a8fa-42b6-a218-e5a585cd600b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:37.959566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7d4d9efd-a8fa-42b6-a218-e5a585cd600b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:37.968464 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7d4d9efd-a8fa-42b6-a218-e5a585cd600b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:37.969150 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7d4d9efd-a8fa-42b6-a218-e5a585cd600b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:37.970034 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7d4d9efd-a8fa-42b6-a218-e5a585cd600b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:37.970589 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7d4d9efd-a8fa-42b6-a218-e5a585cd600b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:38.048101 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ede2014f-a4ef-4f2f-a7ed-e56053c243c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:38.058026 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ede2014f-a4ef-4f2f-a7ed-e56053c243c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:38.059792 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ede2014f-a4ef-4f2f-a7ed-e56053c243c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:38.061193 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ede2014f-a4ef-4f2f-a7ed-e56053c243c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.301746 Jul 19 09:27:38.061754 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 185/394] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:37 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:27:38.068279 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-bfa4ed02-0492-4fa8-94a6-d88542a9adff req-9a03b7f1-aec3-4397-9103-343f146c562c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d15c4b-d521-4bd3-9fa3-fb58ce655bc7", "name": "network-vif-deleted", "tag": "8a59df2b-0df2-4f0d-a574-189011bc73a8"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:38.070201 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:27:38.070201 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:27:38.077715 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-bfa4ed02-0492-4fa8-94a6-d88542a9adff req-9a03b7f1-aec3-4397-9103-343f146c562c service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:38.078416 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-bfa4ed02-0492-4fa8-94a6-d88542a9adff req-9a03b7f1-aec3-4397-9103-343f146c562c service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:38.093239 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-bfa4ed02-0492-4fa8-94a6-d88542a9adff req-9a03b7f1-aec3-4397-9103-343f146c562c service nova] Creating event network-vif-deleted:8a59df2b-0df2-4f0d-a574-189011bc73a8 for instance 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 on hv-cinder-79338 Jul 19 09:27:38.099919 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-bfa4ed02-0492-4fa8-94a6-d88542a9adff req-9a03b7f1-aec3-4397-9103-343f146c562c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036791 Jul 19 09:27:38.104487 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 186/395] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:27:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:27:38.148616 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-269a8e43-0dbe-4c09-8593-0ecf9909cf05 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:38.149322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-269a8e43-0dbe-4c09-8593-0ecf9909cf05 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:38.155523 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-269a8e43-0dbe-4c09-8593-0ecf9909cf05 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:38.155967 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-269a8e43-0dbe-4c09-8593-0ecf9909cf05 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:38.156748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-269a8e43-0dbe-4c09-8593-0ecf9909cf05 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:38.157178 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-269a8e43-0dbe-4c09-8593-0ecf9909cf05 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:38.168159 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7d4d9efd-a8fa-42b6-a218-e5a585cd600b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:38.175830 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7d4d9efd-a8fa-42b6-a218-e5a585cd600b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1503 microversion: 2.1 time: 0.222044 Jul 19 09:27:38.177397 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 210/396] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:37 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:38.192436 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-86bc5ebd-e337-4a0a-8886-4688ba6db5b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03a7f631-684a-426c-b964-6f8235ef3cfe"}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:38.193546 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-86bc5ebd-e337-4a0a-8886-4688ba6db5b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:38.194686 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-269a8e43-0dbe-4c09-8593-0ecf9909cf05 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:38.195257 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-269a8e43-0dbe-4c09-8593-0ecf9909cf05 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:38.195773 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.objects.instance [None req-269a8e43-0dbe-4c09-8593-0ecf9909cf05 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lazy-loading 'fault' on Instance uuid 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 {{(pid=107464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:27:38.199197 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-86bc5ebd-e337-4a0a-8886-4688ba6db5b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:38.199645 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-86bc5ebd-e337-4a0a-8886-4688ba6db5b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:38.200406 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-86bc5ebd-e337-4a0a-8886-4688ba6db5b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:38.200840 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-86bc5ebd-e337-4a0a-8886-4688ba6db5b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:38.223663 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-86bc5ebd-e337-4a0a-8886-4688ba6db5b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] HTTP exception thrown: Cannot 'attach_volume' instance 0ee4430d-0d5f-45bd-848e-aa6f05870b67 while it is in vm_state rescued Jul 19 09:27:38.224251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-86bc5ebd-e337-4a0a-8886-4688ba6db5b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Returning 409 to user: Cannot 'attach_volume' instance 0ee4430d-0d5f-45bd-848e-aa6f05870b67 while it is in vm_state rescued {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:27:38.225107 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-86bc5ebd-e337-4a0a-8886-4688ba6db5b2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "POST /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.036510 Jul 19 09:27:38.225647 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 211/397] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Jul 19 09:27:38 2021] POST /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/os-volume_attachments => generated 152 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 19 09:27:38.233782 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-62516228-bfdf-4872-acc9-9c25d9f4e058 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:38.234305 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-62516228-bfdf-4872-acc9-9c25d9f4e058 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:38.240983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62516228-bfdf-4872-acc9-9c25d9f4e058 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:38.241435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62516228-bfdf-4872-acc9-9c25d9f4e058 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:38.241681 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-269a8e43-0dbe-4c09-8593-0ecf9909cf05 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd459f96a8b49119dca8de55d589bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54885ada1574c34ad5d06b8be3f8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:38.242206 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62516228-bfdf-4872-acc9-9c25d9f4e058 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:38.242637 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62516228-bfdf-4872-acc9-9c25d9f4e058 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:38.248857 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-269a8e43-0dbe-4c09-8593-0ecf9909cf05 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 200 len: 1303 microversion: 2.1 time: 0.107048 Jul 19 09:27:38.249425 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 187/398] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:38 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:38.308211 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-62516228-bfdf-4872-acc9-9c25d9f4e058 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "POST /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/action" status: 202 len: 0 microversion: 2.1 time: 0.077633 Jul 19 09:27:38.309038 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 212/399] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:38 2021] POST /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:27:38.317671 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ba90a0a3-7746-467f-af3e-d72e35eebdfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:38.318281 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ba90a0a3-7746-467f-af3e-d72e35eebdfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:38.324708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba90a0a3-7746-467f-af3e-d72e35eebdfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:38.325158 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba90a0a3-7746-467f-af3e-d72e35eebdfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:38.326726 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba90a0a3-7746-467f-af3e-d72e35eebdfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:38.327213 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba90a0a3-7746-467f-af3e-d72e35eebdfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:38.520549 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ba90a0a3-7746-467f-af3e-d72e35eebdfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:38.527756 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ba90a0a3-7746-467f-af3e-d72e35eebdfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1511 microversion: 2.1 time: 0.213905 Jul 19 09:27:38.528324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 188/400] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:38 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:38.749795 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2391aa1e-61a2-4e4a-b361-74c531008915 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:38.750480 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2391aa1e-61a2-4e4a-b361-74c531008915 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:38.756360 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2391aa1e-61a2-4e4a-b361-74c531008915 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:38.756803 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2391aa1e-61a2-4e4a-b361-74c531008915 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:38.757554 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2391aa1e-61a2-4e4a-b361-74c531008915 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:38.757978 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2391aa1e-61a2-4e4a-b361-74c531008915 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:38.899404 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2391aa1e-61a2-4e4a-b361-74c531008915 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:38.907798 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2391aa1e-61a2-4e4a-b361-74c531008915 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.161963 Jul 19 09:27:38.909664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 213/401] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:38 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:38.984124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-643d9421-d6e6-4ded-9a57-5a9a9c52e16f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:38.984639 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-643d9421-d6e6-4ded-9a57-5a9a9c52e16f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:38.991731 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-643d9421-d6e6-4ded-9a57-5a9a9c52e16f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:38.992116 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-643d9421-d6e6-4ded-9a57-5a9a9c52e16f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:38.992891 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-643d9421-d6e6-4ded-9a57-5a9a9c52e16f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:38.993329 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-643d9421-d6e6-4ded-9a57-5a9a9c52e16f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:39.017811 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-643d9421-d6e6-4ded-9a57-5a9a9c52e16f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Going to try to terminate instance {{(pid=107464) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:27:39.080714 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c217f959-1fdf-43fa-9ec3-cede74d95de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:39.081312 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c217f959-1fdf-43fa-9ec3-cede74d95de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:39.088195 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c217f959-1fdf-43fa-9ec3-cede74d95de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:39.088724 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c217f959-1fdf-43fa-9ec3-cede74d95de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:39.089716 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c217f959-1fdf-43fa-9ec3-cede74d95de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:39.090228 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c217f959-1fdf-43fa-9ec3-cede74d95de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:39.093915 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-643d9421-d6e6-4ded-9a57-5a9a9c52e16f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 204 len: 0 microversion: 2.1 time: 0.113106 Jul 19 09:27:39.094731 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 189/402] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:27:38 2021] DELETE /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 09:27:39.103927 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c54a1314-1d3b-4070-a677-35818c41fb2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:39.104623 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c54a1314-1d3b-4070-a677-35818c41fb2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:39.110119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c54a1314-1d3b-4070-a677-35818c41fb2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:39.110568 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c54a1314-1d3b-4070-a677-35818c41fb2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:39.111392 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c54a1314-1d3b-4070-a677-35818c41fb2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:39.111827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c54a1314-1d3b-4070-a677-35818c41fb2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:39.227421 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c217f959-1fdf-43fa-9ec3-cede74d95de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:39.234963 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c217f959-1fdf-43fa-9ec3-cede74d95de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:39.236515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c217f959-1fdf-43fa-9ec3-cede74d95de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:39.237637 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c217f959-1fdf-43fa-9ec3-cede74d95de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.160686 Jul 19 09:27:39.238194 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 214/403] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:39 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:27:39.246985 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c54a1314-1d3b-4070-a677-35818c41fb2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:39.255047 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c54a1314-1d3b-4070-a677-35818c41fb2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1513 microversion: 2.1 time: 0.154559 Jul 19 09:27:39.255612 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 190/404] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:39 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:39.265170 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-09f2170c-9ef7-44e9-99f9-0d2d2bfd9181 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:39.265794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-09f2170c-9ef7-44e9-99f9-0d2d2bfd9181 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] [instance: 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:39.271591 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09f2170c-9ef7-44e9-99f9-0d2d2bfd9181 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:39.272039 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09f2170c-9ef7-44e9-99f9-0d2d2bfd9181 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:39.272789 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09f2170c-9ef7-44e9-99f9-0d2d2bfd9181 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:39.273225 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09f2170c-9ef7-44e9-99f9-0d2d2bfd9181 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:39.286101 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-09f2170c-9ef7-44e9-99f9-0d2d2bfd9181 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] HTTP exception thrown: Instance 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 could not be found. Jul 19 09:27:39.286667 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-09f2170c-9ef7-44e9-99f9-0d2d2bfd9181 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] Returning 404 to user: Instance 74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:27:39.287495 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-09f2170c-9ef7-44e9-99f9-0d2d2bfd9181 tempest-VolumesNegativeTest-397390972 tempest-VolumesNegativeTest-397390972-project] 10.222.0.16 "GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7" status: 404 len: 111 microversion: 2.1 time: 0.025901 Jul 19 09:27:39.287997 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 215/405] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:39 2021] GET /compute/v2.1/servers/74d15c4b-d521-4bd3-9fa3-fb58ce655bc7 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:27:39.545669 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9af04550-f7c4-410d-a4fb-9585136bdad0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:39.546356 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9af04550-f7c4-410d-a4fb-9585136bdad0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:39.552579 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9af04550-f7c4-410d-a4fb-9585136bdad0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:39.553027 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9af04550-f7c4-410d-a4fb-9585136bdad0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:39.553802 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9af04550-f7c4-410d-a4fb-9585136bdad0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:39.554237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9af04550-f7c4-410d-a4fb-9585136bdad0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:39.686899 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9af04550-f7c4-410d-a4fb-9585136bdad0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:39.695208 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9af04550-f7c4-410d-a4fb-9585136bdad0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1511 microversion: 2.1 time: 0.153546 Jul 19 09:27:39.695789 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 191/406] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:39 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:39.927112 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-706fd812-8080-4ee1-8cf3-92dd52a5c8aa tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:39.927714 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-706fd812-8080-4ee1-8cf3-92dd52a5c8aa tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:39.933460 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-706fd812-8080-4ee1-8cf3-92dd52a5c8aa tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:39.933909 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-706fd812-8080-4ee1-8cf3-92dd52a5c8aa tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:39.934663 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-706fd812-8080-4ee1-8cf3-92dd52a5c8aa tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:39.935121 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-706fd812-8080-4ee1-8cf3-92dd52a5c8aa tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:40.070419 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-706fd812-8080-4ee1-8cf3-92dd52a5c8aa tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:40.078373 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-706fd812-8080-4ee1-8cf3-92dd52a5c8aa tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.155241 Jul 19 09:27:40.078938 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 216/407] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:39 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:40.256093 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d2ff17e5-073e-4c03-8f4b-919abb74932d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:40.256692 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d2ff17e5-073e-4c03-8f4b-919abb74932d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:40.262390 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d2ff17e5-073e-4c03-8f4b-919abb74932d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:40.262837 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d2ff17e5-073e-4c03-8f4b-919abb74932d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:40.263633 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d2ff17e5-073e-4c03-8f4b-919abb74932d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:40.264073 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d2ff17e5-073e-4c03-8f4b-919abb74932d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:40.272269 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-286c7535-1c63-44a4-a962-a3c4e80035ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:40.272868 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-286c7535-1c63-44a4-a962-a3c4e80035ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:40.278642 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-286c7535-1c63-44a4-a962-a3c4e80035ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:40.279084 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-286c7535-1c63-44a4-a962-a3c4e80035ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:40.279847 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-286c7535-1c63-44a4-a962-a3c4e80035ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:40.280277 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-286c7535-1c63-44a4-a962-a3c4e80035ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:40.416384 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d2ff17e5-073e-4c03-8f4b-919abb74932d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:40.426826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d2ff17e5-073e-4c03-8f4b-919abb74932d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:40.428703 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d2ff17e5-073e-4c03-8f4b-919abb74932d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:40.429883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d2ff17e5-073e-4c03-8f4b-919abb74932d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.178060 Jul 19 09:27:40.440860 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 192/408] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:40 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:27:40.623251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-286c7535-1c63-44a4-a962-a3c4e80035ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:40.631603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-286c7535-1c63-44a4-a962-a3c4e80035ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1513 microversion: 2.1 time: 0.362831 Jul 19 09:27:40.632168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 217/409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:40 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1513 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:40.712452 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-44584ba3-e437-4a53-9db6-be977b33ac8b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:40.713058 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-44584ba3-e437-4a53-9db6-be977b33ac8b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:40.718640 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44584ba3-e437-4a53-9db6-be977b33ac8b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:40.719117 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44584ba3-e437-4a53-9db6-be977b33ac8b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:40.719876 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44584ba3-e437-4a53-9db6-be977b33ac8b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:40.720303 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44584ba3-e437-4a53-9db6-be977b33ac8b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:40.861258 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-44584ba3-e437-4a53-9db6-be977b33ac8b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:40.869148 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-44584ba3-e437-4a53-9db6-be977b33ac8b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1511 microversion: 2.1 time: 0.160437 Jul 19 09:27:40.869797 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 193/410] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:40 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:41.095736 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-67db5880-adf2-4871-a32c-77d25430712b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:41.096475 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-67db5880-adf2-4871-a32c-77d25430712b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:41.102698 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67db5880-adf2-4871-a32c-77d25430712b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:41.103177 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67db5880-adf2-4871-a32c-77d25430712b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:41.103940 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67db5880-adf2-4871-a32c-77d25430712b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:41.110317 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67db5880-adf2-4871-a32c-77d25430712b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:41.189231 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1070227104", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-260386788", "security_groups": [{"name": "tempest-secgroup-smoke-203468028"}], "networks": [{"uuid": "98dd916d-a5b5-4bdc-86ee-b4842e29d07c"}], "block_device_mapping_v2": [{"uuid": "1e5ee6a2-294e-4792-9f09-dfb1a079ce01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:41.252775 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-67db5880-adf2-4871-a32c-77d25430712b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:41.264789 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-67db5880-adf2-4871-a32c-77d25430712b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.172687 Jul 19 09:27:41.265429 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 218/411] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:41 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:41.302719 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.network.neutron [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] validate_networks() for [('98dd916d-a5b5-4bdc-86ee-b4842e29d07c', None, None, None)] {{(pid=107464) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:27:41.448421 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f6319346-fa23-4bce-9d90-f488e4d374ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:41.449027 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f6319346-fa23-4bce-9d90-f488e4d374ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:41.455357 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6319346-fa23-4bce-9d90-f488e4d374ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:41.455977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6319346-fa23-4bce-9d90-f488e4d374ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:41.456949 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6319346-fa23-4bce-9d90-f488e4d374ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:41.457961 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6319346-fa23-4bce-9d90-f488e4d374ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:41.614458 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f6319346-fa23-4bce-9d90-f488e4d374ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:41.622996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f6319346-fa23-4bce-9d90-f488e4d374ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:41.624545 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f6319346-fa23-4bce-9d90-f488e4d374ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:41.625678 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f6319346-fa23-4bce-9d90-f488e4d374ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.180887 Jul 19 09:27:41.626233 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 219/412] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:41 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:27:41.648663 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-46411e9d-0dcd-4807-8d46-e0de277ea258 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:41.649494 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-46411e9d-0dcd-4807-8d46-e0de277ea258 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:41.655878 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-46411e9d-0dcd-4807-8d46-e0de277ea258 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:41.656512 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-46411e9d-0dcd-4807-8d46-e0de277ea258 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:41.657447 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-46411e9d-0dcd-4807-8d46-e0de277ea258 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:41.657874 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-46411e9d-0dcd-4807-8d46-e0de277ea258 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:41.711104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Flavor limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:27:41.711641 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Image limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:27:41.712219 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Flavor pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:27:41.712883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Image pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:27:41.713391 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:27:41.722128 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:41.722890 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:41.724041 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:41.724708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:41.743354 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Getting quotas for project 9d2bfe61cc3e4e789667d6a0ac2792a9. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:27:41.747411 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Getting quotas for user a447ab1e5e9a4660b457e639d7e96339 and project 9d2bfe61cc3e4e789667d6a0ac2792a9. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:27:41.811501 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-46411e9d-0dcd-4807-8d46-e0de277ea258 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:41.816217 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Going to run 1 instances... {{(pid=107464) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:27:41.818394 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e5ee6a2-294e-4792-9f09-dfb1a079ce01',volume_size=None,volume_type=None)] {{(pid=107464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:27:41.825237 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-46411e9d-0dcd-4807-8d46-e0de277ea258 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1513 microversion: 2.1 time: 0.180836 Jul 19 09:27:41.826441 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 220/413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:41 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:41.886531 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e10c67d3-f129-4f27-bc38-0e7b50eb2ab7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:41.887439 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e10c67d3-f129-4f27-bc38-0e7b50eb2ab7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:41.893437 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e10c67d3-f129-4f27-bc38-0e7b50eb2ab7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:41.893980 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e10c67d3-f129-4f27-bc38-0e7b50eb2ab7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:41.895579 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e10c67d3-f129-4f27-bc38-0e7b50eb2ab7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:41.896232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e10c67d3-f129-4f27-bc38-0e7b50eb2ab7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:41.957593 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-390731b8-13df-4c72-b1cf-daf45bb93f1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.772292 Jul 19 09:27:41.958854 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 194/414] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 09:27:41 2021] POST /compute/v2.1/servers => generated 405 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 09:27:41.968363 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ccf953e9-79cc-43e4-825a-d0d2d7a3b60a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:41.968980 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ccf953e9-79cc-43e4-825a-d0d2d7a3b60a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:42.033886 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ccf953e9-79cc-43e4-825a-d0d2d7a3b60a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:42.042891 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ccf953e9-79cc-43e4-825a-d0d2d7a3b60a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1088 microversion: 2.1 time: 0.078213 Jul 19 09:27:42.044036 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 195/415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:41 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1088 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:42.061250 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e10c67d3-f129-4f27-bc38-0e7b50eb2ab7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:42.069778 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e10c67d3-f129-4f27-bc38-0e7b50eb2ab7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1511 microversion: 2.1 time: 0.187021 Jul 19 09:27:42.070469 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 221/416] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:41 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1511 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:42.281468 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8a53a4b9-3cbd-4a0d-bf81-937d5ada152a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:42.282187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8a53a4b9-3cbd-4a0d-bf81-937d5ada152a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:42.288996 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8a53a4b9-3cbd-4a0d-bf81-937d5ada152a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:42.289691 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8a53a4b9-3cbd-4a0d-bf81-937d5ada152a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:42.290470 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8a53a4b9-3cbd-4a0d-bf81-937d5ada152a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:42.291107 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8a53a4b9-3cbd-4a0d-bf81-937d5ada152a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:42.473442 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8a53a4b9-3cbd-4a0d-bf81-937d5ada152a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:42.481414 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8a53a4b9-3cbd-4a0d-bf81-937d5ada152a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.203515 Jul 19 09:27:42.482629 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 196/417] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:42 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:42.643910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0dfca875-19fc-4ba2-88ae-3e4db52569e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:42.645804 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0dfca875-19fc-4ba2-88ae-3e4db52569e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:42.651544 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0dfca875-19fc-4ba2-88ae-3e4db52569e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:42.652136 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0dfca875-19fc-4ba2-88ae-3e4db52569e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:42.653017 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0dfca875-19fc-4ba2-88ae-3e4db52569e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:42.653638 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0dfca875-19fc-4ba2-88ae-3e4db52569e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:42.800261 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0dfca875-19fc-4ba2-88ae-3e4db52569e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:42.808783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0dfca875-19fc-4ba2-88ae-3e4db52569e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:42.810519 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0dfca875-19fc-4ba2-88ae-3e4db52569e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:42.811677 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0dfca875-19fc-4ba2-88ae-3e4db52569e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.171508 Jul 19 09:27:42.812417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 222/418] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:42 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:27:42.842535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-52013762-f598-43f1-a20b-4b7d4660bdde tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:42.843182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-52013762-f598-43f1-a20b-4b7d4660bdde tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:42.852201 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52013762-f598-43f1-a20b-4b7d4660bdde tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:42.852860 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52013762-f598-43f1-a20b-4b7d4660bdde tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:42.853644 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52013762-f598-43f1-a20b-4b7d4660bdde tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:42.854084 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52013762-f598-43f1-a20b-4b7d4660bdde tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:42.953015 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-52013762-f598-43f1-a20b-4b7d4660bdde tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:42.961638 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-52013762-f598-43f1-a20b-4b7d4660bdde tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 200 len: 1471 microversion: 2.1 time: 0.122700 Jul 19 09:27:42.962269 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 197/419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:42 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 1471 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:43.017713 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-c109832f-5bad-401b-b284-f67258fc54f2 req-76f283b6-8ebe-4556-98a9-10daeb02dbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39f0be4-c55f-4e6c-bccf-be5be1e02919", "name": "network-vif-deleted", "tag": "08717e43-af33-4b3c-b9f8-aaeffec6936b"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:43.020251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:27:43.020251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:27:43.034760 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-c109832f-5bad-401b-b284-f67258fc54f2 req-76f283b6-8ebe-4556-98a9-10daeb02dbe6 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:43.038770 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-c109832f-5bad-401b-b284-f67258fc54f2 req-76f283b6-8ebe-4556-98a9-10daeb02dbe6 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:43.060050 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1647d3fa-349b-47e2-9f30-9a3e7b824c40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:43.060667 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1647d3fa-349b-47e2-9f30-9a3e7b824c40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:43.061924 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-c109832f-5bad-401b-b284-f67258fc54f2 req-76f283b6-8ebe-4556-98a9-10daeb02dbe6 service nova] Creating event network-vif-deleted:08717e43-af33-4b3c-b9f8-aaeffec6936b for instance c39f0be4-c55f-4e6c-bccf-be5be1e02919 on hv-cinder-79338 Jul 19 09:27:43.072741 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-c109832f-5bad-401b-b284-f67258fc54f2 req-76f283b6-8ebe-4556-98a9-10daeb02dbe6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058763 Jul 19 09:27:43.073908 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 223/420] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:27:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:27:43.076248 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1647d3fa-349b-47e2-9f30-9a3e7b824c40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:43.076862 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1647d3fa-349b-47e2-9f30-9a3e7b824c40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:43.077484 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1647d3fa-349b-47e2-9f30-9a3e7b824c40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:43.078095 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1647d3fa-349b-47e2-9f30-9a3e7b824c40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:43.093758 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-dbebd079-80ed-448a-890f-c68656c33d01 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:43.094450 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-dbebd079-80ed-448a-890f-c68656c33d01 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:43.111291 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dbebd079-80ed-448a-890f-c68656c33d01 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:43.117693 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dbebd079-80ed-448a-890f-c68656c33d01 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:43.119983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dbebd079-80ed-448a-890f-c68656c33d01 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:43.120491 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dbebd079-80ed-448a-890f-c68656c33d01 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:43.160773 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1647d3fa-349b-47e2-9f30-9a3e7b824c40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:43.182249 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1647d3fa-349b-47e2-9f30-9a3e7b824c40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1186 microversion: 2.1 time: 0.125854 Jul 19 09:27:43.191859 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 198/421] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:43 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1186 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:43.296829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-dbebd079-80ed-448a-890f-c68656c33d01 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:43.308265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-dbebd079-80ed-448a-890f-c68656c33d01 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1517 microversion: 2.1 time: 0.218551 Jul 19 09:27:43.309906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 224/422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:43 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1517 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:43.499839 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d7fad3aa-25d5-4bde-ad34-ebe5590d025c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:43.501904 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d7fad3aa-25d5-4bde-ad34-ebe5590d025c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:43.508274 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d7fad3aa-25d5-4bde-ad34-ebe5590d025c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:43.509118 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d7fad3aa-25d5-4bde-ad34-ebe5590d025c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:43.511065 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d7fad3aa-25d5-4bde-ad34-ebe5590d025c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:43.511818 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d7fad3aa-25d5-4bde-ad34-ebe5590d025c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:43.800709 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d7fad3aa-25d5-4bde-ad34-ebe5590d025c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:43.809266 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d7fad3aa-25d5-4bde-ad34-ebe5590d025c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.313535 Jul 19 09:27:43.810022 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 199/423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:43 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:43.829372 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-04542505-9b9a-4afd-9c38-f6ddfd77b459 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:43.829995 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-04542505-9b9a-4afd-9c38-f6ddfd77b459 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:43.836706 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-04542505-9b9a-4afd-9c38-f6ddfd77b459 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:43.837234 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-04542505-9b9a-4afd-9c38-f6ddfd77b459 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:43.838090 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-04542505-9b9a-4afd-9c38-f6ddfd77b459 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:43.838599 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-04542505-9b9a-4afd-9c38-f6ddfd77b459 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:43.979717 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-755de84e-9a52-4c3f-b072-6d345e615373 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:43.980560 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-755de84e-9a52-4c3f-b072-6d345e615373 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: c39f0be4-c55f-4e6c-bccf-be5be1e02919] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:43.987322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-755de84e-9a52-4c3f-b072-6d345e615373 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:43.988155 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-755de84e-9a52-4c3f-b072-6d345e615373 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:43.989275 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-755de84e-9a52-4c3f-b072-6d345e615373 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:43.989936 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-755de84e-9a52-4c3f-b072-6d345e615373 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:44.018995 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-755de84e-9a52-4c3f-b072-6d345e615373 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] HTTP exception thrown: Instance c39f0be4-c55f-4e6c-bccf-be5be1e02919 could not be found. Jul 19 09:27:44.020568 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-755de84e-9a52-4c3f-b072-6d345e615373 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Returning 404 to user: Instance c39f0be4-c55f-4e6c-bccf-be5be1e02919 could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:27:44.024122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-755de84e-9a52-4c3f-b072-6d345e615373 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919" status: 404 len: 111 microversion: 2.1 time: 0.047775 Jul 19 09:27:44.025811 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 200/424] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:43 2021] GET /compute/v2.1/servers/c39f0be4-c55f-4e6c-bccf-be5be1e02919 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:27:44.054894 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-04542505-9b9a-4afd-9c38-f6ddfd77b459 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:44.069186 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-04542505-9b9a-4afd-9c38-f6ddfd77b459 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:44.089161 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-04542505-9b9a-4afd-9c38-f6ddfd77b459 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:44.090715 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-04542505-9b9a-4afd-9c38-f6ddfd77b459 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.264994 Jul 19 09:27:44.091554 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 225/425] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:43 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:27:44.201087 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-694baad3-ad93-4023-bc81-b3157cd812cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:44.201902 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-694baad3-ad93-4023-bc81-b3157cd812cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:44.209481 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-694baad3-ad93-4023-bc81-b3157cd812cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:44.210090 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-694baad3-ad93-4023-bc81-b3157cd812cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:44.211075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-694baad3-ad93-4023-bc81-b3157cd812cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:44.211527 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-694baad3-ad93-4023-bc81-b3157cd812cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:44.507797 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-694baad3-ad93-4023-bc81-b3157cd812cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:44.515235 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-694baad3-ad93-4023-bc81-b3157cd812cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1271 microversion: 2.1 time: 0.318712 Jul 19 09:27:44.523392 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 201/426] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:44 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1271 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:44.751252 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b53bded4-de0f-402a-b76f-6462e08ce522 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:44.751872 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b53bded4-de0f-402a-b76f-6462e08ce522 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:44.758721 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b53bded4-de0f-402a-b76f-6462e08ce522 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:44.759543 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b53bded4-de0f-402a-b76f-6462e08ce522 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:44.760637 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b53bded4-de0f-402a-b76f-6462e08ce522 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:44.761447 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b53bded4-de0f-402a-b76f-6462e08ce522 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:44.826532 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1e1c3c61-cc21-475f-b93b-01a7bb8e4044 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:44.828028 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1e1c3c61-cc21-475f-b93b-01a7bb8e4044 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:44.836119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1e1c3c61-cc21-475f-b93b-01a7bb8e4044 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:44.836576 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1e1c3c61-cc21-475f-b93b-01a7bb8e4044 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:44.837363 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1e1c3c61-cc21-475f-b93b-01a7bb8e4044 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:44.837799 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1e1c3c61-cc21-475f-b93b-01a7bb8e4044 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:44.964749 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b53bded4-de0f-402a-b76f-6462e08ce522 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:44.971906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b53bded4-de0f-402a-b76f-6462e08ce522 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1517 microversion: 2.1 time: 0.224779 Jul 19 09:27:44.972474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 226/427] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:44 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1517 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:44.988415 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-88a08281-5c0c-41f1-8d9f-6379f8c99ae2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "926a9a41-9cb7-411f-b76d-664eec21d671"}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:44.989684 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-88a08281-5c0c-41f1-8d9f-6379f8c99ae2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:44.996811 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88a08281-5c0c-41f1-8d9f-6379f8c99ae2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:44.997766 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88a08281-5c0c-41f1-8d9f-6379f8c99ae2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:44.999299 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88a08281-5c0c-41f1-8d9f-6379f8c99ae2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:44.999898 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88a08281-5c0c-41f1-8d9f-6379f8c99ae2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:45.118331 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1e1c3c61-cc21-475f-b93b-01a7bb8e4044 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:45.126161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1e1c3c61-cc21-475f-b93b-01a7bb8e4044 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.304489 Jul 19 09:27:45.135766 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 202/428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:44 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:45.142665 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-e6d94cdc-5ebb-4f0e-be00-7144e04f2617 req-ded19307-1e78-44af-a3f6-90fde978e67a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee02e36e-7587-4ab3-b367-08e1c9b26c69", "tag": "8c6fc9b0-949b-4965-80e0-e84ca522d2a6"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:45.144250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:27:45.144250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:27:45.152340 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-e6d94cdc-5ebb-4f0e-be00-7144e04f2617 req-ded19307-1e78-44af-a3f6-90fde978e67a service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:45.153015 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-e6d94cdc-5ebb-4f0e-be00-7144e04f2617 req-ded19307-1e78-44af-a3f6-90fde978e67a service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:45.165654 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-e6d94cdc-5ebb-4f0e-be00-7144e04f2617 req-ded19307-1e78-44af-a3f6-90fde978e67a service nova] Creating event network-changed:8c6fc9b0-949b-4965-80e0-e84ca522d2a6 for instance ee02e36e-7587-4ab3-b367-08e1c9b26c69 on hv-cinder-79338 Jul 19 09:27:45.170919 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-e6d94cdc-5ebb-4f0e-be00-7144e04f2617 req-ded19307-1e78-44af-a3f6-90fde978e67a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033879 Jul 19 09:27:45.171921 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 203/429] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:27:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:27:45.178172 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f1ee763d-c98c-42a4-ac77-877096ff4545 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:45.178944 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f1ee763d-c98c-42a4-ac77-877096ff4545 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:45.185159 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f1ee763d-c98c-42a4-ac77-877096ff4545 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:45.185691 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f1ee763d-c98c-42a4-ac77-877096ff4545 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:45.186552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f1ee763d-c98c-42a4-ac77-877096ff4545 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:45.187088 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f1ee763d-c98c-42a4-ac77-877096ff4545 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:45.341053 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f1ee763d-c98c-42a4-ac77-877096ff4545 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:45.352706 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f1ee763d-c98c-42a4-ac77-877096ff4545 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:45.354203 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f1ee763d-c98c-42a4-ac77-877096ff4545 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:45.355505 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f1ee763d-c98c-42a4-ac77-877096ff4545 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.182296 Jul 19 09:27:45.356050 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 204/430] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:45 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:27:45.533116 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9e51dcfe-b830-4d0c-ba78-d48be2e301e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:45.533803 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9e51dcfe-b830-4d0c-ba78-d48be2e301e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:45.541064 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9e51dcfe-b830-4d0c-ba78-d48be2e301e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:45.541507 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9e51dcfe-b830-4d0c-ba78-d48be2e301e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:45.542736 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9e51dcfe-b830-4d0c-ba78-d48be2e301e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:45.543295 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9e51dcfe-b830-4d0c-ba78-d48be2e301e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:45.679607 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9e51dcfe-b830-4d0c-ba78-d48be2e301e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:45.686759 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9e51dcfe-b830-4d0c-ba78-d48be2e301e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1271 microversion: 2.1 time: 0.157760 Jul 19 09:27:45.687432 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 205/431] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:45 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:46.142832 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a9be6c5d-b58f-466f-b817-73e05851fca5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:46.143495 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a9be6c5d-b58f-466f-b817-73e05851fca5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:46.149442 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a9be6c5d-b58f-466f-b817-73e05851fca5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:46.149897 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a9be6c5d-b58f-466f-b817-73e05851fca5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:46.150663 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a9be6c5d-b58f-466f-b817-73e05851fca5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:46.151123 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a9be6c5d-b58f-466f-b817-73e05851fca5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:46.280516 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a9be6c5d-b58f-466f-b817-73e05851fca5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:46.288178 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a9be6c5d-b58f-466f-b817-73e05851fca5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.149067 Jul 19 09:27:46.288736 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 206/432] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:46 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:46.372809 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c684e1f8-5973-4b44-827a-99b7d856ea60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:46.373431 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c684e1f8-5973-4b44-827a-99b7d856ea60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:46.379143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c684e1f8-5973-4b44-827a-99b7d856ea60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:46.379588 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c684e1f8-5973-4b44-827a-99b7d856ea60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:46.380340 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c684e1f8-5973-4b44-827a-99b7d856ea60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:46.380769 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c684e1f8-5973-4b44-827a-99b7d856ea60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:46.724732 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c684e1f8-5973-4b44-827a-99b7d856ea60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:46.732829 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c684e1f8-5973-4b44-827a-99b7d856ea60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:46.734320 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c684e1f8-5973-4b44-827a-99b7d856ea60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:46.735484 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c684e1f8-5973-4b44-827a-99b7d856ea60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.366207 Jul 19 09:27:46.736041 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 207/433] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:46 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:27:46.740276 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-17440f5e-ae1c-415c-afe0-1271099f441b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:46.740864 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-17440f5e-ae1c-415c-afe0-1271099f441b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:46.746172 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-17440f5e-ae1c-415c-afe0-1271099f441b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:46.746615 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-17440f5e-ae1c-415c-afe0-1271099f441b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:46.747414 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-17440f5e-ae1c-415c-afe0-1271099f441b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:46.747842 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-17440f5e-ae1c-415c-afe0-1271099f441b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:46.874953 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-17440f5e-ae1c-415c-afe0-1271099f441b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:46.882894 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-17440f5e-ae1c-415c-afe0-1271099f441b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1271 microversion: 2.1 time: 0.145804 Jul 19 09:27:46.883481 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 208/434] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:46 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:47.305024 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5bbfb3c5-01ec-43e8-aa12-b535e97baf43 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:47.305629 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5bbfb3c5-01ec-43e8-aa12-b535e97baf43 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:47.311397 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5bbfb3c5-01ec-43e8-aa12-b535e97baf43 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:47.311841 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5bbfb3c5-01ec-43e8-aa12-b535e97baf43 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:47.312620 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5bbfb3c5-01ec-43e8-aa12-b535e97baf43 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:47.313049 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5bbfb3c5-01ec-43e8-aa12-b535e97baf43 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:47.445756 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5bbfb3c5-01ec-43e8-aa12-b535e97baf43 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:47.453409 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5bbfb3c5-01ec-43e8-aa12-b535e97baf43 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.152018 Jul 19 09:27:47.453965 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 209/435] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:47 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:47.754586 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-28c41b1e-ec85-49b1-b98c-5e439966e8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:47.755335 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-28c41b1e-ec85-49b1-b98c-5e439966e8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:47.762436 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-28c41b1e-ec85-49b1-b98c-5e439966e8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:47.762956 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-28c41b1e-ec85-49b1-b98c-5e439966e8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:47.763713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-28c41b1e-ec85-49b1-b98c-5e439966e8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:47.764153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-28c41b1e-ec85-49b1-b98c-5e439966e8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:47.816132 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-88a08281-5c0c-41f1-8d9f-6379f8c99ae2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "POST /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.831998 Jul 19 09:27:47.821761 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 227/436] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Jul 19 09:27:44 2021] POST /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/os-volume_attachments => generated 194 bytes in 2834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:27:47.900351 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-41c69d93-365b-40c1-8ebc-bd1fc99af614 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:47.901097 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-41c69d93-365b-40c1-8ebc-bd1fc99af614 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:47.909002 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-41c69d93-365b-40c1-8ebc-bd1fc99af614 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:47.909873 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-41c69d93-365b-40c1-8ebc-bd1fc99af614 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:47.911460 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-41c69d93-365b-40c1-8ebc-bd1fc99af614 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:47.912255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-41c69d93-365b-40c1-8ebc-bd1fc99af614 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:48.050407 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-28c41b1e-ec85-49b1-b98c-5e439966e8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:48.060233 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-28c41b1e-ec85-49b1-b98c-5e439966e8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:48.061749 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-28c41b1e-ec85-49b1-b98c-5e439966e8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:48.061895 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-41c69d93-365b-40c1-8ebc-bd1fc99af614 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:48.063265 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-28c41b1e-ec85-49b1-b98c-5e439966e8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.313274 Jul 19 09:27:48.063897 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 210/437] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:47 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:27:48.071574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-41c69d93-365b-40c1-8ebc-bd1fc99af614 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1271 microversion: 2.1 time: 0.175417 Jul 19 09:27:48.072100 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 228/438] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:47 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:48.314547 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e9481266-a780-463d-a47f-a5b94e398ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a29cd883-a371-41fc-a3e9-551d0331958d"}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:48.315783 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e9481266-a780-463d-a47f-a5b94e398ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:48.322054 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e9481266-a780-463d-a47f-a5b94e398ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:48.322503 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e9481266-a780-463d-a47f-a5b94e398ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:48.323610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e9481266-a780-463d-a47f-a5b94e398ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:48.324112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e9481266-a780-463d-a47f-a5b94e398ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:48.418809 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-e9481266-a780-463d-a47f-a5b94e398ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] HTTP exception thrown: Invalid volume: volume a29cd883-a371-41fc-a3e9-551d0331958d is already attached to instances: 249757f0-2b91-4c45-b523-d9514051420c Jul 19 09:27:48.419760 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e9481266-a780-463d-a47f-a5b94e398ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Returning 400 to user: Invalid volume: volume a29cd883-a371-41fc-a3e9-551d0331958d is already attached to instances: 249757f0-2b91-4c45-b523-d9514051420c {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:27:48.420928 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e9481266-a780-463d-a47f-a5b94e398ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "POST /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110436 Jul 19 09:27:48.421962 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 211/439] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Jul 19 09:27:48 2021] POST /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 09:27:48.470732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6cedc852-dfd4-41e9-9d19-030cdc236dc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:48.471378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6cedc852-dfd4-41e9-9d19-030cdc236dc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:48.484851 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6cedc852-dfd4-41e9-9d19-030cdc236dc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:48.485546 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6cedc852-dfd4-41e9-9d19-030cdc236dc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:48.486564 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6cedc852-dfd4-41e9-9d19-030cdc236dc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:48.487175 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6cedc852-dfd4-41e9-9d19-030cdc236dc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:48.508519 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8df6b9e0-4abe-4847-a261-9def8745be1d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:48.509277 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8df6b9e0-4abe-4847-a261-9def8745be1d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:48.517880 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8df6b9e0-4abe-4847-a261-9def8745be1d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:48.518333 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8df6b9e0-4abe-4847-a261-9def8745be1d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:48.519145 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8df6b9e0-4abe-4847-a261-9def8745be1d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:48.520105 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8df6b9e0-4abe-4847-a261-9def8745be1d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:48.650169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.objects.instance [None req-8df6b9e0-4abe-4847-a261-9def8745be1d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lazy-loading 'services' on Instance uuid 249757f0-2b91-4c45-b523-d9514051420c {{(pid=107464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:27:48.689079 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6cedc852-dfd4-41e9-9d19-030cdc236dc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:48.698140 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6cedc852-dfd4-41e9-9d19-030cdc236dc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.231014 Jul 19 09:27:48.698826 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 229/440] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:48 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:48.738839 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8df6b9e0-4abe-4847-a261-9def8745be1d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "DELETE /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c/os-volume_attachments/a29cd883-a371-41fc-a3e9-551d0331958d" status: 202 len: 0 microversion: 2.1 time: 0.234788 Jul 19 09:27:48.739661 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 212/441] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Jul 19 09:27:48 2021] DELETE /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c/os-volume_attachments/a29cd883-a371-41fc-a3e9-551d0331958d => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:27:49.084272 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d05bb750-2822-4986-99e4-2b503edd5e5c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:49.085051 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d05bb750-2822-4986-99e4-2b503edd5e5c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:49.090109 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-45e2971e-15ce-43d6-bbc7-0cb9067c5ba4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:49.090771 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d05bb750-2822-4986-99e4-2b503edd5e5c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:49.091057 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-45e2971e-15ce-43d6-bbc7-0cb9067c5ba4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:49.091504 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d05bb750-2822-4986-99e4-2b503edd5e5c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:49.092283 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d05bb750-2822-4986-99e4-2b503edd5e5c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:49.092847 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d05bb750-2822-4986-99e4-2b503edd5e5c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:49.098717 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45e2971e-15ce-43d6-bbc7-0cb9067c5ba4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:49.099397 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45e2971e-15ce-43d6-bbc7-0cb9067c5ba4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:49.106721 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45e2971e-15ce-43d6-bbc7-0cb9067c5ba4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:49.107706 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-45e2971e-15ce-43d6-bbc7-0cb9067c5ba4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:49.230269 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d05bb750-2822-4986-99e4-2b503edd5e5c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:49.238123 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d05bb750-2822-4986-99e4-2b503edd5e5c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:49.239706 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d05bb750-2822-4986-99e4-2b503edd5e5c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:49.240893 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d05bb750-2822-4986-99e4-2b503edd5e5c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.161217 Jul 19 09:27:49.241636 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 230/442] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:49 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:27:49.338238 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-45e2971e-15ce-43d6-bbc7-0cb9067c5ba4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:49.346935 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-45e2971e-15ce-43d6-bbc7-0cb9067c5ba4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1259 microversion: 2.1 time: 0.261782 Jul 19 09:27:49.347666 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 213/443] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:49 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1259 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:49.715212 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1c413b1a-3fb4-4e4b-8eac-892682b92956 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:49.715839 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1c413b1a-3fb4-4e4b-8eac-892682b92956 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:49.722912 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c413b1a-3fb4-4e4b-8eac-892682b92956 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:49.723599 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c413b1a-3fb4-4e4b-8eac-892682b92956 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:49.724703 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c413b1a-3fb4-4e4b-8eac-892682b92956 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:49.725158 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c413b1a-3fb4-4e4b-8eac-892682b92956 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:49.876713 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1c413b1a-3fb4-4e4b-8eac-892682b92956 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:49.883407 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1c413b1a-3fb4-4e4b-8eac-892682b92956 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.171640 Jul 19 09:27:49.884282 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 231/444] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:49 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:50.259018 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d7b6054e-78e4-4bc9-be2e-6d381a883549 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:50.259614 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d7b6054e-78e4-4bc9-be2e-6d381a883549 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:50.265520 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d7b6054e-78e4-4bc9-be2e-6d381a883549 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:50.265965 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d7b6054e-78e4-4bc9-be2e-6d381a883549 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:50.266712 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d7b6054e-78e4-4bc9-be2e-6d381a883549 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:50.267173 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d7b6054e-78e4-4bc9-be2e-6d381a883549 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:50.365575 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0edd6b9a-454d-45dd-9333-840b0fa1e197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:50.366175 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0edd6b9a-454d-45dd-9333-840b0fa1e197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:50.372005 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0edd6b9a-454d-45dd-9333-840b0fa1e197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:50.372470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0edd6b9a-454d-45dd-9333-840b0fa1e197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:50.373261 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0edd6b9a-454d-45dd-9333-840b0fa1e197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:50.373689 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0edd6b9a-454d-45dd-9333-840b0fa1e197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:50.400670 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d7b6054e-78e4-4bc9-be2e-6d381a883549 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:50.408603 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d7b6054e-78e4-4bc9-be2e-6d381a883549 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:50.410587 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d7b6054e-78e4-4bc9-be2e-6d381a883549 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:50.411743 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d7b6054e-78e4-4bc9-be2e-6d381a883549 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.156551 Jul 19 09:27:50.412504 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 214/445] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:50 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:27:50.504661 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0edd6b9a-454d-45dd-9333-840b0fa1e197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:50.511871 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0edd6b9a-454d-45dd-9333-840b0fa1e197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1259 microversion: 2.1 time: 0.150375 Jul 19 09:27:50.512378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 232/446] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:50 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:50.900552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-64249837-1405-4b76-8956-d20de126ccbb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:50.901275 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-64249837-1405-4b76-8956-d20de126ccbb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:50.908263 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-64249837-1405-4b76-8956-d20de126ccbb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:50.908950 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-64249837-1405-4b76-8956-d20de126ccbb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:50.909791 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-64249837-1405-4b76-8956-d20de126ccbb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:50.910888 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-64249837-1405-4b76-8956-d20de126ccbb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:51.053809 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-64249837-1405-4b76-8956-d20de126ccbb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:51.063579 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-64249837-1405-4b76-8956-d20de126ccbb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.166941 Jul 19 09:27:51.064139 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 215/447] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:50 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:51.430848 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-68c89980-303e-4064-af5a-8212bb8998e4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:51.431429 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-68c89980-303e-4064-af5a-8212bb8998e4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:51.437684 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-68c89980-303e-4064-af5a-8212bb8998e4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:51.438136 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-68c89980-303e-4064-af5a-8212bb8998e4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:51.438896 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-68c89980-303e-4064-af5a-8212bb8998e4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:51.439373 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-68c89980-303e-4064-af5a-8212bb8998e4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:51.528136 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-816beabc-88f4-48ec-98f0-e0521efcaeef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:51.529118 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-816beabc-88f4-48ec-98f0-e0521efcaeef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:51.534646 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-816beabc-88f4-48ec-98f0-e0521efcaeef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:51.535115 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-816beabc-88f4-48ec-98f0-e0521efcaeef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:51.535888 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-816beabc-88f4-48ec-98f0-e0521efcaeef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:51.536326 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-816beabc-88f4-48ec-98f0-e0521efcaeef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:51.574596 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-68c89980-303e-4064-af5a-8212bb8998e4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:51.582407 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-68c89980-303e-4064-af5a-8212bb8998e4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:51.583957 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-68c89980-303e-4064-af5a-8212bb8998e4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:51.585097 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-68c89980-303e-4064-af5a-8212bb8998e4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.158019 Jul 19 09:27:51.585660 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 233/448] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:51 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:27:51.667514 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-816beabc-88f4-48ec-98f0-e0521efcaeef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:51.674642 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-816beabc-88f4-48ec-98f0-e0521efcaeef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1259 microversion: 2.1 time: 0.150278 Jul 19 09:27:51.675239 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 216/449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:51 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:52.079504 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a4db44d2-3b7b-4931-9b20-7e1cfa9f0bf6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:52.080119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a4db44d2-3b7b-4931-9b20-7e1cfa9f0bf6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:52.086291 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4db44d2-3b7b-4931-9b20-7e1cfa9f0bf6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:52.086748 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4db44d2-3b7b-4931-9b20-7e1cfa9f0bf6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:52.087541 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4db44d2-3b7b-4931-9b20-7e1cfa9f0bf6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:52.087978 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4db44d2-3b7b-4931-9b20-7e1cfa9f0bf6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:52.218379 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a4db44d2-3b7b-4931-9b20-7e1cfa9f0bf6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:52.226096 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a4db44d2-3b7b-4931-9b20-7e1cfa9f0bf6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.150218 Jul 19 09:27:52.226666 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 234/450] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:52 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:52.602999 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ca87ac1f-319a-4558-8574-3a13c6f95173 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:52.603585 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ca87ac1f-319a-4558-8574-3a13c6f95173 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:52.609778 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca87ac1f-319a-4558-8574-3a13c6f95173 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:52.610267 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca87ac1f-319a-4558-8574-3a13c6f95173 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:52.611027 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca87ac1f-319a-4558-8574-3a13c6f95173 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:52.611488 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca87ac1f-319a-4558-8574-3a13c6f95173 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:52.692093 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7b57b3db-072a-4f85-9900-5fb352f0ee6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:52.692732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7b57b3db-072a-4f85-9900-5fb352f0ee6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:52.698371 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b57b3db-072a-4f85-9900-5fb352f0ee6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:52.698820 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b57b3db-072a-4f85-9900-5fb352f0ee6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:52.699620 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b57b3db-072a-4f85-9900-5fb352f0ee6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:52.700059 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b57b3db-072a-4f85-9900-5fb352f0ee6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:52.746965 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ca87ac1f-319a-4558-8574-3a13c6f95173 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:52.755260 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ca87ac1f-319a-4558-8574-3a13c6f95173 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:52.756785 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ca87ac1f-319a-4558-8574-3a13c6f95173 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:52.757923 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ca87ac1f-319a-4558-8574-3a13c6f95173 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.158710 Jul 19 09:27:52.758481 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 217/451] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:52 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:27:52.830531 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7b57b3db-072a-4f85-9900-5fb352f0ee6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:52.837765 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7b57b3db-072a-4f85-9900-5fb352f0ee6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1259 microversion: 2.1 time: 0.149941 Jul 19 09:27:52.838336 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 235/452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:52 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:53.243531 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cc974a59-d155-4bbf-9266-587f822bcb81 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:53.244076 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cc974a59-d155-4bbf-9266-587f822bcb81 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:53.249950 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc974a59-d155-4bbf-9266-587f822bcb81 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:53.250401 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc974a59-d155-4bbf-9266-587f822bcb81 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:53.251202 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc974a59-d155-4bbf-9266-587f822bcb81 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:53.251641 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc974a59-d155-4bbf-9266-587f822bcb81 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:53.380574 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cc974a59-d155-4bbf-9266-587f822bcb81 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:53.388324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cc974a59-d155-4bbf-9266-587f822bcb81 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.148423 Jul 19 09:27:53.389014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 218/453] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:53 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:53.776437 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-92706bc7-f23d-43d6-becc-d0629439c5b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:53.777038 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-92706bc7-f23d-43d6-becc-d0629439c5b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:53.782910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-92706bc7-f23d-43d6-becc-d0629439c5b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:53.783380 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-92706bc7-f23d-43d6-becc-d0629439c5b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:53.784135 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-92706bc7-f23d-43d6-becc-d0629439c5b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:53.784560 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-92706bc7-f23d-43d6-becc-d0629439c5b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:53.853543 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f66c7953-dcd8-4446-a60f-51dd3ac6c81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:53.854251 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f66c7953-dcd8-4446-a60f-51dd3ac6c81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:53.859995 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f66c7953-dcd8-4446-a60f-51dd3ac6c81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:53.860462 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f66c7953-dcd8-4446-a60f-51dd3ac6c81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:53.861217 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f66c7953-dcd8-4446-a60f-51dd3ac6c81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:53.861643 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f66c7953-dcd8-4446-a60f-51dd3ac6c81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:53.920166 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-92706bc7-f23d-43d6-becc-d0629439c5b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:53.927843 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-92706bc7-f23d-43d6-becc-d0629439c5b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:53.929344 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-92706bc7-f23d-43d6-becc-d0629439c5b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:53.930477 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-92706bc7-f23d-43d6-becc-d0629439c5b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.157988 Jul 19 09:27:53.931065 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 236/454] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:53 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:27:53.992406 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f66c7953-dcd8-4446-a60f-51dd3ac6c81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:53.999668 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f66c7953-dcd8-4446-a60f-51dd3ac6c81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1259 microversion: 2.1 time: 0.149803 Jul 19 09:27:54.000238 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 219/455] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:53 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:54.114750 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1337316627", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452", "networks": [{"uuid": "eb5cf022-63e0-4d71-8824-54a92c2210b1"}]}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:54.168179 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.network.neutron [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] validate_networks() for [('eb5cf022-63e0-4d71-8824-54a92c2210b1', None, None, None)] {{(pid=107463) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:27:54.405400 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5ef6afbd-a109-4366-8d87-5c0b8777368d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:54.405999 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5ef6afbd-a109-4366-8d87-5c0b8777368d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:54.412602 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ef6afbd-a109-4366-8d87-5c0b8777368d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:54.413042 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ef6afbd-a109-4366-8d87-5c0b8777368d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:54.413801 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ef6afbd-a109-4366-8d87-5c0b8777368d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:54.414231 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ef6afbd-a109-4366-8d87-5c0b8777368d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:54.503022 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Flavor limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:27:54.503501 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Image limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:27:54.503970 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Flavor pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:27:54.504373 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Image pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:27:54.504778 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:27:54.513304 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:54.513630 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:54.514426 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:54.514853 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:54.532042 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Getting quotas for project 3197460e0e344400b48795ca25fbd373. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:27:54.536449 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Getting quotas for user a7ec3e6c648a43ba91287cda79019993 and project 3197460e0e344400b48795ca25fbd373. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:27:54.547272 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Going to run 1 instances... {{(pid=107463) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:27:54.549597 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:27:54.554187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5ef6afbd-a109-4366-8d87-5c0b8777368d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:54.561936 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5ef6afbd-a109-4366-8d87-5c0b8777368d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.160185 Jul 19 09:27:54.562503 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 220/456] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:54 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:54.592977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9a89b2b7-4a65-491c-bef7-8c86e67e3bfb tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.482340 Jul 19 09:27:54.593539 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 237/457] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 09:27:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 09:27:54.603135 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-47ed4f00-c284-4385-b9dc-180824239c41 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:54.603773 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-47ed4f00-c284-4385-b9dc-180824239c41 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:54.655631 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-47ed4f00-c284-4385-b9dc-180824239c41 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:54.662151 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-47ed4f00-c284-4385-b9dc-180824239c41 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1219 microversion: 2.1 time: 0.062702 Jul 19 09:27:54.662753 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 221/458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:54 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:54.948740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d8f9ce07-9859-446f-b298-af2299836f9f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:54.949383 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d8f9ce07-9859-446f-b298-af2299836f9f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:54.957505 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d8f9ce07-9859-446f-b298-af2299836f9f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:54.959433 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d8f9ce07-9859-446f-b298-af2299836f9f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:54.960199 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d8f9ce07-9859-446f-b298-af2299836f9f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:54.960660 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d8f9ce07-9859-446f-b298-af2299836f9f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:55.016651 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ed0251e6-abdd-4a4f-9d45-2a3be22a2c92 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:55.017391 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ed0251e6-abdd-4a4f-9d45-2a3be22a2c92 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:55.023833 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ed0251e6-abdd-4a4f-9d45-2a3be22a2c92 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:55.024282 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ed0251e6-abdd-4a4f-9d45-2a3be22a2c92 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:55.025046 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ed0251e6-abdd-4a4f-9d45-2a3be22a2c92 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:55.025482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ed0251e6-abdd-4a4f-9d45-2a3be22a2c92 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:55.102021 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d8f9ce07-9859-446f-b298-af2299836f9f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:55.110370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d8f9ce07-9859-446f-b298-af2299836f9f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:55.112167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d8f9ce07-9859-446f-b298-af2299836f9f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:55.114074 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d8f9ce07-9859-446f-b298-af2299836f9f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1722 microversion: 2.20 time: 0.169132 Jul 19 09:27:55.125007 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 238/459] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:54 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:27:55.181229 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ed0251e6-abdd-4a4f-9d45-2a3be22a2c92 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:55.188542 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ed0251e6-abdd-4a4f-9d45-2a3be22a2c92 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1259 microversion: 2.1 time: 0.175610 Jul 19 09:27:55.189154 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 222/460] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:55 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:55.579359 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9eb9ddb3-02e1-4333-ad4b-faba9ef2be48 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:55.579958 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9eb9ddb3-02e1-4333-ad4b-faba9ef2be48 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:55.586683 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9eb9ddb3-02e1-4333-ad4b-faba9ef2be48 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:55.587158 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9eb9ddb3-02e1-4333-ad4b-faba9ef2be48 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:55.587924 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9eb9ddb3-02e1-4333-ad4b-faba9ef2be48 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:55.588356 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9eb9ddb3-02e1-4333-ad4b-faba9ef2be48 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:55.679421 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-432b478c-159d-454e-822e-aba2fc6cf667 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:55.680103 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-432b478c-159d-454e-822e-aba2fc6cf667 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:55.686350 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-432b478c-159d-454e-822e-aba2fc6cf667 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:55.686831 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-432b478c-159d-454e-822e-aba2fc6cf667 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:55.687620 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-432b478c-159d-454e-822e-aba2fc6cf667 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:55.688050 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-432b478c-159d-454e-822e-aba2fc6cf667 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:55.741096 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9eb9ddb3-02e1-4333-ad4b-faba9ef2be48 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:55.750901 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9eb9ddb3-02e1-4333-ad4b-faba9ef2be48 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.175163 Jul 19 09:27:55.751661 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 239/461] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:55 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:55.770950 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-432b478c-159d-454e-822e-aba2fc6cf667 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:55.778273 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-432b478c-159d-454e-822e-aba2fc6cf667 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1279 microversion: 2.1 time: 0.102655 Jul 19 09:27:55.778943 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 223/462] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:55 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1279 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:56.132247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f90c08c4-e0dd-4ceb-ad41-f56065f9ca0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:56.132991 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f90c08c4-e0dd-4ceb-ad41-f56065f9ca0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:56.138923 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f90c08c4-e0dd-4ceb-ad41-f56065f9ca0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:56.139405 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f90c08c4-e0dd-4ceb-ad41-f56065f9ca0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:56.140174 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f90c08c4-e0dd-4ceb-ad41-f56065f9ca0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:56.140614 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f90c08c4-e0dd-4ceb-ad41-f56065f9ca0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:56.205765 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a4d99fab-bbc5-4789-937f-b9d07705bec0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:56.207026 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a4d99fab-bbc5-4789-937f-b9d07705bec0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:56.213548 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4d99fab-bbc5-4789-937f-b9d07705bec0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:56.214322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4d99fab-bbc5-4789-937f-b9d07705bec0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:56.215421 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4d99fab-bbc5-4789-937f-b9d07705bec0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:56.224591 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4d99fab-bbc5-4789-937f-b9d07705bec0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:56.285212 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f90c08c4-e0dd-4ceb-ad41-f56065f9ca0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:56.295660 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f90c08c4-e0dd-4ceb-ad41-f56065f9ca0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:56.297531 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f90c08c4-e0dd-4ceb-ad41-f56065f9ca0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:56.298687 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f90c08c4-e0dd-4ceb-ad41-f56065f9ca0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1743 microversion: 2.20 time: 0.170318 Jul 19 09:27:56.299359 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 240/463] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:56 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:27:56.345198 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-26aba876-d52c-48d6-b46d-5b675232a706 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:56.346185 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-26aba876-d52c-48d6-b46d-5b675232a706 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:56.352498 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26aba876-d52c-48d6-b46d-5b675232a706 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:56.352946 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26aba876-d52c-48d6-b46d-5b675232a706 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:56.353712 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26aba876-d52c-48d6-b46d-5b675232a706 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:56.354142 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26aba876-d52c-48d6-b46d-5b675232a706 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:56.377039 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.objects.instance [None req-26aba876-d52c-48d6-b46d-5b675232a706 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lazy-loading 'flavor' on Instance uuid 0ee4430d-0d5f-45bd-848e-aa6f05870b67 {{(pid=107463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:27:56.502195 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a4d99fab-bbc5-4789-937f-b9d07705bec0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:56.511394 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a4d99fab-bbc5-4789-937f-b9d07705bec0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1259 microversion: 2.1 time: 0.309466 Jul 19 09:27:56.511974 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 224/464] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:56 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1259 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:56.513630 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-26aba876-d52c-48d6-b46d-5b675232a706 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "POST /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/action" status: 200 len: 32 microversion: 2.1 time: 0.170771 Jul 19 09:27:56.518456 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 241/465] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:27:56 2021] POST /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 09:27:56.524506 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c6124dd4-b825-490d-8cd5-4fab6adbb68c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:56.525209 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c6124dd4-b825-490d-8cd5-4fab6adbb68c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:56.531114 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c6124dd4-b825-490d-8cd5-4fab6adbb68c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:56.531710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c6124dd4-b825-490d-8cd5-4fab6adbb68c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:56.532352 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c6124dd4-b825-490d-8cd5-4fab6adbb68c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:56.532831 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c6124dd4-b825-490d-8cd5-4fab6adbb68c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:56.770512 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2cabd9ed-9321-4aba-89a9-2c8cbe2987b0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:56.771251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2cabd9ed-9321-4aba-89a9-2c8cbe2987b0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:56.777872 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2cabd9ed-9321-4aba-89a9-2c8cbe2987b0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:56.778320 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2cabd9ed-9321-4aba-89a9-2c8cbe2987b0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:56.779109 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2cabd9ed-9321-4aba-89a9-2c8cbe2987b0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:56.779538 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2cabd9ed-9321-4aba-89a9-2c8cbe2987b0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:56.893311 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c6124dd4-b825-490d-8cd5-4fab6adbb68c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:56.903696 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c6124dd4-b825-490d-8cd5-4fab6adbb68c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.382539 Jul 19 09:27:56.907017 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 225/466] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:56 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:56.913748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-192d1af7-c54e-4e87-b588-acb3a0207406 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:56.914875 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-192d1af7-c54e-4e87-b588-acb3a0207406 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:56.923418 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-192d1af7-c54e-4e87-b588-acb3a0207406 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:56.924200 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-192d1af7-c54e-4e87-b588-acb3a0207406 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:56.926419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-192d1af7-c54e-4e87-b588-acb3a0207406 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:56.927098 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-192d1af7-c54e-4e87-b588-acb3a0207406 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:56.929233 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2cabd9ed-9321-4aba-89a9-2c8cbe2987b0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:56.937591 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2cabd9ed-9321-4aba-89a9-2c8cbe2987b0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.172606 Jul 19 09:27:56.938378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 242/467] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:56 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:57.312977 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-192d1af7-c54e-4e87-b588-acb3a0207406 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:57.317576 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-10ff9490-7ccd-4617-aed1-c3c974bb24e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:57.318632 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-10ff9490-7ccd-4617-aed1-c3c974bb24e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:57.324538 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-192d1af7-c54e-4e87-b588-acb3a0207406 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1319 microversion: 2.1 time: 0.415653 Jul 19 09:27:57.325177 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 226/468] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:56 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1319 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:57.335488 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-10ff9490-7ccd-4617-aed1-c3c974bb24e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:57.335488 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-10ff9490-7ccd-4617-aed1-c3c974bb24e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:57.335488 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-10ff9490-7ccd-4617-aed1-c3c974bb24e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:57.335488 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-10ff9490-7ccd-4617-aed1-c3c974bb24e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:57.407240 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-60810889", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452", "networks": [{"uuid": "ffe762f0-68bd-4db8-b328-c8e2b8fc1624"}]}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:57.471454 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.network.neutron [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] validate_networks() for [('ffe762f0-68bd-4db8-b328-c8e2b8fc1624', None, None, None)] {{(pid=107464) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:27:57.489879 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-10ff9490-7ccd-4617-aed1-c3c974bb24e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:57.497715 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-10ff9490-7ccd-4617-aed1-c3c974bb24e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:57.500123 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-10ff9490-7ccd-4617-aed1-c3c974bb24e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:57.500394 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-10ff9490-7ccd-4617-aed1-c3c974bb24e3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1743 microversion: 2.20 time: 0.186645 Jul 19 09:27:57.501267 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 243/469] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:57 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1743 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:27:57.527843 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4e89435c-de47-4a00-9f1d-30f19a556876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:57.528644 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4e89435c-de47-4a00-9f1d-30f19a556876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:57.535451 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4e89435c-de47-4a00-9f1d-30f19a556876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:57.536696 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4e89435c-de47-4a00-9f1d-30f19a556876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:57.538833 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4e89435c-de47-4a00-9f1d-30f19a556876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:57.539462 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4e89435c-de47-4a00-9f1d-30f19a556876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:57.689500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4e89435c-de47-4a00-9f1d-30f19a556876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:57.697695 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4e89435c-de47-4a00-9f1d-30f19a556876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1259 microversion: 2.1 time: 0.173347 Jul 19 09:27:57.698578 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 244/470] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:57 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:57.923638 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1a25fa71-63a7-4b48-846c-9a3059b2190b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:57.924249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1a25fa71-63a7-4b48-846c-9a3059b2190b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:57.930808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1a25fa71-63a7-4b48-846c-9a3059b2190b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:57.931374 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1a25fa71-63a7-4b48-846c-9a3059b2190b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:57.932158 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1a25fa71-63a7-4b48-846c-9a3059b2190b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:57.932598 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1a25fa71-63a7-4b48-846c-9a3059b2190b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:58.073165 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1a25fa71-63a7-4b48-846c-9a3059b2190b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:58.081004 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1a25fa71-63a7-4b48-846c-9a3059b2190b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.160941 Jul 19 09:27:58.082115 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 245/471] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:57 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:58.090978 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-073314f0-73b2-47a8-9278-a966ded71d85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:58.090978 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-073314f0-73b2-47a8-9278-a966ded71d85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:58.092608 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-073314f0-73b2-47a8-9278-a966ded71d85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:58.093058 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-073314f0-73b2-47a8-9278-a966ded71d85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:58.093822 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-073314f0-73b2-47a8-9278-a966ded71d85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:58.094256 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-073314f0-73b2-47a8-9278-a966ded71d85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:58.238456 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-073314f0-73b2-47a8-9278-a966ded71d85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:58.246309 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-073314f0-73b2-47a8-9278-a966ded71d85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.163225 Jul 19 09:27:58.246877 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 246/472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:58 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:58.251388 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-4dd7fb4c-f5cf-465a-87bc-e23cb79d2903 req-e66dda12-8a4e-4d41-8a31-9644e04faa17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36be7eb9-715d-4855-9896-49929b6d5013", "tag": "0945ccd4-7d3c-4acc-a559-260dab74f7fe"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:58.252917 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:27:58.252917 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:27:58.259468 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-4dd7fb4c-f5cf-465a-87bc-e23cb79d2903 req-e66dda12-8a4e-4d41-8a31-9644e04faa17 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:58.259933 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-4dd7fb4c-f5cf-465a-87bc-e23cb79d2903 req-e66dda12-8a4e-4d41-8a31-9644e04faa17 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:58.270844 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-4dd7fb4c-f5cf-465a-87bc-e23cb79d2903 req-e66dda12-8a4e-4d41-8a31-9644e04faa17 service nova] Creating event network-changed:0945ccd4-7d3c-4acc-a559-260dab74f7fe for instance 36be7eb9-715d-4855-9896-49929b6d5013 on hv-cinder-79338 Jul 19 09:27:58.275445 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-4dd7fb4c-f5cf-465a-87bc-e23cb79d2903 req-e66dda12-8a4e-4d41-8a31-9644e04faa17 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027413 Jul 19 09:27:58.276264 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 247/473] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:27:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:27:58.341958 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e49e4d32-c3e2-416b-a656-e51c74d45e2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:58.342641 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e49e4d32-c3e2-416b-a656-e51c74d45e2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:58.348681 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e49e4d32-c3e2-416b-a656-e51c74d45e2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:58.349126 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e49e4d32-c3e2-416b-a656-e51c74d45e2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:58.349888 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e49e4d32-c3e2-416b-a656-e51c74d45e2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:58.350345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e49e4d32-c3e2-416b-a656-e51c74d45e2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:58.361092 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Flavor limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:27:58.361546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Image limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:27:58.362046 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Flavor pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:27:58.362457 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Image pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:27:58.362873 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:27:58.371573 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:58.372028 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:58.372869 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:58.373312 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:58.390830 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Getting quotas for project 4427b775629d442d9448281ff5171b24. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:27:58.395530 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Getting quotas for user 6b45b7dbaf5c41a998a64ef62132ea6d and project 4427b775629d442d9448281ff5171b24. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:27:58.406310 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Going to run 1 instances... {{(pid=107464) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:27:58.408675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:27:58.453867 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c3115c1c-0be1-465f-aa81-d26921df95e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052134 Jul 19 09:27:58.459864 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 227/474] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 09:27:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 09:27:58.464888 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a6b20443-dace-4555-857f-871ee199780c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:58.465624 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a6b20443-dace-4555-857f-871ee199780c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:58.496416 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e49e4d32-c3e2-416b-a656-e51c74d45e2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:58.506231 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e49e4d32-c3e2-416b-a656-e51c74d45e2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1319 microversion: 2.1 time: 0.168156 Jul 19 09:27:58.506807 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 248/475] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:58 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:58.521422 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1b83de31-0d4a-4226-87f0-e8f6f7c47c98 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:58.522118 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1b83de31-0d4a-4226-87f0-e8f6f7c47c98 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:58.528390 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b83de31-0d4a-4226-87f0-e8f6f7c47c98 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:58.529043 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b83de31-0d4a-4226-87f0-e8f6f7c47c98 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:58.529810 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b83de31-0d4a-4226-87f0-e8f6f7c47c98 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:58.530308 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b83de31-0d4a-4226-87f0-e8f6f7c47c98 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:58.539787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a6b20443-dace-4555-857f-871ee199780c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:58.547403 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a6b20443-dace-4555-857f-871ee199780c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1216 microversion: 2.1 time: 0.086215 Jul 19 09:27:58.547974 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 228/476] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:58 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1216 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:58.701167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1b83de31-0d4a-4226-87f0-e8f6f7c47c98 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:58.714361 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1b83de31-0d4a-4226-87f0-e8f6f7c47c98 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:58.716037 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1b83de31-0d4a-4226-87f0-e8f6f7c47c98 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:58.717840 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1b83de31-0d4a-4226-87f0-e8f6f7c47c98 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1738 microversion: 2.20 time: 0.204258 Jul 19 09:27:58.718929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 249/477] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:58 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:27:58.719109 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6affc1df-79e0-470b-b094-5dfaf0d93a00 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:58.721676 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6affc1df-79e0-470b-b094-5dfaf0d93a00 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:58.730386 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6affc1df-79e0-470b-b094-5dfaf0d93a00 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:58.730856 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6affc1df-79e0-470b-b094-5dfaf0d93a00 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:58.731676 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6affc1df-79e0-470b-b094-5dfaf0d93a00 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:58.732288 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6affc1df-79e0-470b-b094-5dfaf0d93a00 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:58.815671 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-be51a357-7af8-41be-9bf3-e39e061a8bd0 req-8a40b912-963d-482d-8e48-3ca5465329db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cbcf278-5d96-4715-9238-5dd27d17311d", "name": "network-vif-plugged", "status": "completed", "tag": "d8df4a87-cd9e-43a5-9d1d-ace9278bf484"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:27:58.818533 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:27:58.818533 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:27:58.837844 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-be51a357-7af8-41be-9bf3-e39e061a8bd0 req-8a40b912-963d-482d-8e48-3ca5465329db service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:58.838474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-be51a357-7af8-41be-9bf3-e39e061a8bd0 req-8a40b912-963d-482d-8e48-3ca5465329db service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:58.859948 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-be51a357-7af8-41be-9bf3-e39e061a8bd0 req-8a40b912-963d-482d-8e48-3ca5465329db service nova] Creating event network-vif-plugged:d8df4a87-cd9e-43a5-9d1d-ace9278bf484 for instance 5cbcf278-5d96-4715-9238-5dd27d17311d on hv-cinder-79338 Jul 19 09:27:58.867400 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-be51a357-7af8-41be-9bf3-e39e061a8bd0 req-8a40b912-963d-482d-8e48-3ca5465329db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056737 Jul 19 09:27:58.868357 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 250/478] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:27:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 09:27:58.951955 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6affc1df-79e0-470b-b094-5dfaf0d93a00 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:58.960088 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6affc1df-79e0-470b-b094-5dfaf0d93a00 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1259 microversion: 2.1 time: 0.247767 Jul 19 09:27:58.960740 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 229/479] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:58 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1259 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:59.098870 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-97b7adf7-1ae9-4839-8a70-6b0bed4edcdb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:59.099603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-97b7adf7-1ae9-4839-8a70-6b0bed4edcdb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:59.105576 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-97b7adf7-1ae9-4839-8a70-6b0bed4edcdb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:59.106040 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-97b7adf7-1ae9-4839-8a70-6b0bed4edcdb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:59.107001 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-97b7adf7-1ae9-4839-8a70-6b0bed4edcdb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:59.107431 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-97b7adf7-1ae9-4839-8a70-6b0bed4edcdb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:59.263185 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5c8e4bb8-56c7-4209-a07e-270671c7e9bd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:59.264217 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5c8e4bb8-56c7-4209-a07e-270671c7e9bd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:59.270887 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c8e4bb8-56c7-4209-a07e-270671c7e9bd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:59.271525 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c8e4bb8-56c7-4209-a07e-270671c7e9bd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:59.271697 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-97b7adf7-1ae9-4839-8a70-6b0bed4edcdb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:59.272802 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c8e4bb8-56c7-4209-a07e-270671c7e9bd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:59.273560 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c8e4bb8-56c7-4209-a07e-270671c7e9bd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:59.281773 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-97b7adf7-1ae9-4839-8a70-6b0bed4edcdb tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.187180 Jul 19 09:27:59.283589 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 251/480] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:59 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:27:59.517713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5c8e4bb8-56c7-4209-a07e-270671c7e9bd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:59.527180 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-871ba450-a66f-4132-8bf7-64648c4338b7 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:59.528616 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-871ba450-a66f-4132-8bf7-64648c4338b7 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:59.528890 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5c8e4bb8-56c7-4209-a07e-270671c7e9bd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.269472 Jul 19 09:27:59.530096 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 230/481] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:59 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:59.544230 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-871ba450-a66f-4132-8bf7-64648c4338b7 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:59.544889 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-871ba450-a66f-4132-8bf7-64648c4338b7 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:59.545671 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-871ba450-a66f-4132-8bf7-64648c4338b7 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:59.546361 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-871ba450-a66f-4132-8bf7-64648c4338b7 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:59.564222 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-807d86a8-3e91-46ff-bc01-f868b87b41b9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:59.564914 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-807d86a8-3e91-46ff-bc01-f868b87b41b9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:59.571820 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-807d86a8-3e91-46ff-bc01-f868b87b41b9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:59.572361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-807d86a8-3e91-46ff-bc01-f868b87b41b9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:59.573194 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-807d86a8-3e91-46ff-bc01-f868b87b41b9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:59.573693 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-807d86a8-3e91-46ff-bc01-f868b87b41b9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:59.658698 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-807d86a8-3e91-46ff-bc01-f868b87b41b9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:59.670231 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-807d86a8-3e91-46ff-bc01-f868b87b41b9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1268 microversion: 2.1 time: 0.109514 Jul 19 09:27:59.679768 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 231/482] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:59 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1268 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:59.729412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-871ba450-a66f-4132-8bf7-64648c4338b7 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:27:59.736367 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4cc8f370-f6e2-4a0c-a851-8958ed70c33a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:59.737172 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4cc8f370-f6e2-4a0c-a851-8958ed70c33a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:59.743444 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-871ba450-a66f-4132-8bf7-64648c4338b7 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1319 microversion: 2.1 time: 0.221817 Jul 19 09:27:59.744040 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 252/483] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:59 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:27:59.744462 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4cc8f370-f6e2-4a0c-a851-8958ed70c33a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:59.744912 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4cc8f370-f6e2-4a0c-a851-8958ed70c33a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:59.745952 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4cc8f370-f6e2-4a0c-a851-8958ed70c33a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:59.746338 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4cc8f370-f6e2-4a0c-a851-8958ed70c33a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:59.979240 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4ea1ae07-015f-45f3-8569-4ac7f3c6238a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:27:59.979878 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4ea1ae07-015f-45f3-8569-4ac7f3c6238a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:27:59.986045 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4ea1ae07-015f-45f3-8569-4ac7f3c6238a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:59.986498 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4ea1ae07-015f-45f3-8569-4ac7f3c6238a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:27:59.987292 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4ea1ae07-015f-45f3-8569-4ac7f3c6238a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:27:59.988460 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4ea1ae07-015f-45f3-8569-4ac7f3c6238a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:00.009075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4cc8f370-f6e2-4a0c-a851-8958ed70c33a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:00.017575 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4cc8f370-f6e2-4a0c-a851-8958ed70c33a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:00.018644 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4cc8f370-f6e2-4a0c-a851-8958ed70c33a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:00.020007 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4cc8f370-f6e2-4a0c-a851-8958ed70c33a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1738 microversion: 2.20 time: 0.287302 Jul 19 09:28:00.021067 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 232/484] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:27:59 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:28:00.132921 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4ea1ae07-015f-45f3-8569-4ac7f3c6238a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:00.141523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4ea1ae07-015f-45f3-8569-4ac7f3c6238a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1259 microversion: 2.1 time: 0.166066 Jul 19 09:28:00.142916 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 253/485] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:27:59 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:28:00.298932 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6587ea54-d26e-458f-a874-82d91d67ae22 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:00.299636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6587ea54-d26e-458f-a874-82d91d67ae22 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:00.306094 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6587ea54-d26e-458f-a874-82d91d67ae22 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:00.306635 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6587ea54-d26e-458f-a874-82d91d67ae22 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:00.307443 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6587ea54-d26e-458f-a874-82d91d67ae22 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:00.307878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6587ea54-d26e-458f-a874-82d91d67ae22 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:00.548020 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3ff2ee2a-2695-4326-8100-e7d856ec97f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:00.549665 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3ff2ee2a-2695-4326-8100-e7d856ec97f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:00.550967 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6587ea54-d26e-458f-a874-82d91d67ae22 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:00.558617 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3ff2ee2a-2695-4326-8100-e7d856ec97f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:00.559681 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3ff2ee2a-2695-4326-8100-e7d856ec97f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:00.560722 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3ff2ee2a-2695-4326-8100-e7d856ec97f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:00.561370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3ff2ee2a-2695-4326-8100-e7d856ec97f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:00.566947 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6587ea54-d26e-458f-a874-82d91d67ae22 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.271720 Jul 19 09:28:00.579759 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 233/486] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:00 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:00.688624 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-72b5fd1e-745e-4bd1-ab0d-4f93e9a1a35e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:00.689263 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-72b5fd1e-745e-4bd1-ab0d-4f93e9a1a35e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:00.696482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72b5fd1e-745e-4bd1-ab0d-4f93e9a1a35e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:00.711518 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72b5fd1e-745e-4bd1-ab0d-4f93e9a1a35e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:00.712366 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72b5fd1e-745e-4bd1-ab0d-4f93e9a1a35e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:00.712807 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72b5fd1e-745e-4bd1-ab0d-4f93e9a1a35e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:00.747806 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3ff2ee2a-2695-4326-8100-e7d856ec97f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:00.758681 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3ff2ee2a-2695-4326-8100-e7d856ec97f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.215777 Jul 19 09:28:00.759649 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 254/487] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:00 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:28:00.764369 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b574fc30-7ef6-4a7b-9d1c-e5a00410b763 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:00.765049 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b574fc30-7ef6-4a7b-9d1c-e5a00410b763 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:00.771686 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b574fc30-7ef6-4a7b-9d1c-e5a00410b763 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:00.772142 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b574fc30-7ef6-4a7b-9d1c-e5a00410b763 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:00.772978 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b574fc30-7ef6-4a7b-9d1c-e5a00410b763 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:00.773418 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b574fc30-7ef6-4a7b-9d1c-e5a00410b763 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:00.973160 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b574fc30-7ef6-4a7b-9d1c-e5a00410b763 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:00.980584 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b574fc30-7ef6-4a7b-9d1c-e5a00410b763 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1319 microversion: 2.1 time: 0.219857 Jul 19 09:28:00.982121 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 255/488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:00 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:01.038236 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5df3125d-c706-4d84-a56b-9b353f7c8d3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:01.038933 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5df3125d-c706-4d84-a56b-9b353f7c8d3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:01.048510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5df3125d-c706-4d84-a56b-9b353f7c8d3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:01.049983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5df3125d-c706-4d84-a56b-9b353f7c8d3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:01.051454 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5df3125d-c706-4d84-a56b-9b353f7c8d3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:01.052447 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5df3125d-c706-4d84-a56b-9b353f7c8d3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:01.223578 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-72b5fd1e-745e-4bd1-ab0d-4f93e9a1a35e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:01.233708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-72b5fd1e-745e-4bd1-ab0d-4f93e9a1a35e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1316 microversion: 2.1 time: 0.548996 Jul 19 09:28:01.237980 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 234/489] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:00 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1316 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:28:01.261095 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3d8e2298-f3ae-4949-9fa6-855b93aa0216 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:01.261874 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3d8e2298-f3ae-4949-9fa6-855b93aa0216 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:01.282529 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3d8e2298-f3ae-4949-9fa6-855b93aa0216 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:01.283367 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3d8e2298-f3ae-4949-9fa6-855b93aa0216 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:01.285318 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3d8e2298-f3ae-4949-9fa6-855b93aa0216 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:01.285940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3d8e2298-f3ae-4949-9fa6-855b93aa0216 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:01.308549 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5df3125d-c706-4d84-a56b-9b353f7c8d3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:01.317148 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5df3125d-c706-4d84-a56b-9b353f7c8d3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:01.318656 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5df3125d-c706-4d84-a56b-9b353f7c8d3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:01.320026 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5df3125d-c706-4d84-a56b-9b353f7c8d3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1738 microversion: 2.20 time: 0.285560 Jul 19 09:28:01.320580 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 256/490] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:01 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1738 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:28:01.325080 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-19ef776d-9327-49c6-8b23-474b8dd73a7a req-af5d0667-98de-4388-a0f1-10016762459f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee02e36e-7587-4ab3-b367-08e1c9b26c69", "name": "network-vif-plugged", "status": "completed", "tag": "8c6fc9b0-949b-4965-80e0-e84ca522d2a6"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:28:01.329152 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:28:01.329152 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:28:01.336998 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-19ef776d-9327-49c6-8b23-474b8dd73a7a req-af5d0667-98de-4388-a0f1-10016762459f service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:01.337699 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-19ef776d-9327-49c6-8b23-474b8dd73a7a req-af5d0667-98de-4388-a0f1-10016762459f service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:01.349506 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-19ef776d-9327-49c6-8b23-474b8dd73a7a req-af5d0667-98de-4388-a0f1-10016762459f service nova] Creating event network-vif-plugged:8c6fc9b0-949b-4965-80e0-e84ca522d2a6 for instance ee02e36e-7587-4ab3-b367-08e1c9b26c69 on hv-cinder-79338 Jul 19 09:28:01.354938 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-19ef776d-9327-49c6-8b23-474b8dd73a7a req-af5d0667-98de-4388-a0f1-10016762459f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032952 Jul 19 09:28:01.355663 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 257/491] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:28:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:28:01.597279 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-274d3eee-c77b-4a4b-bdba-f69aaa20d3c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:01.598858 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-274d3eee-c77b-4a4b-bdba-f69aaa20d3c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:01.613169 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-274d3eee-c77b-4a4b-bdba-f69aaa20d3c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:01.613618 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-274d3eee-c77b-4a4b-bdba-f69aaa20d3c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:01.614399 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-274d3eee-c77b-4a4b-bdba-f69aaa20d3c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:01.614863 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-274d3eee-c77b-4a4b-bdba-f69aaa20d3c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:01.622186 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3d8e2298-f3ae-4949-9fa6-855b93aa0216 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:01.631333 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3d8e2298-f3ae-4949-9fa6-855b93aa0216 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1259 microversion: 2.1 time: 0.380169 Jul 19 09:28:01.647224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 235/492] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:01 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1259 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:01.778167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c2f9cc54-bb7f-40fa-ba6c-92133f8fbb00 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:01.779097 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c2f9cc54-bb7f-40fa-ba6c-92133f8fbb00 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:01.791545 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c2f9cc54-bb7f-40fa-ba6c-92133f8fbb00 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:01.792703 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c2f9cc54-bb7f-40fa-ba6c-92133f8fbb00 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:01.793725 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c2f9cc54-bb7f-40fa-ba6c-92133f8fbb00 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:01.794788 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c2f9cc54-bb7f-40fa-ba6c-92133f8fbb00 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:01.882366 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-274d3eee-c77b-4a4b-bdba-f69aaa20d3c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:01.890623 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-274d3eee-c77b-4a4b-bdba-f69aaa20d3c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.297267 Jul 19 09:28:01.902104 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 258/493] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:01 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:01.907495 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-dc5b6347-b073-47a5-b5ab-fc01e46c5a08 req-0ef9c1bb-238e-4a61-82ff-fc51c6f472d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5684c14-21c0-4aeb-9ca6-9df7ae3111f8", "tag": "16feefe3-38f0-490f-bae0-554b20fb320b"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:28:01.909305 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:28:01.909305 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:28:01.917721 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-dc5b6347-b073-47a5-b5ab-fc01e46c5a08 req-0ef9c1bb-238e-4a61-82ff-fc51c6f472d6 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:01.918437 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-dc5b6347-b073-47a5-b5ab-fc01e46c5a08 req-0ef9c1bb-238e-4a61-82ff-fc51c6f472d6 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:01.930326 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-dc5b6347-b073-47a5-b5ab-fc01e46c5a08 req-0ef9c1bb-238e-4a61-82ff-fc51c6f472d6 service nova] Creating event network-changed:16feefe3-38f0-490f-bae0-554b20fb320b for instance a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 on hv-cinder-79338 Jul 19 09:28:01.936109 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-dc5b6347-b073-47a5-b5ab-fc01e46c5a08 req-0ef9c1bb-238e-4a61-82ff-fc51c6f472d6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032281 Jul 19 09:28:01.937484 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 259/494] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:28:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:28:01.999370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0b78b91c-f873-49e3-b01a-2f5d0413050e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:02.000365 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0b78b91c-f873-49e3-b01a-2f5d0413050e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:02.011070 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0b78b91c-f873-49e3-b01a-2f5d0413050e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:02.011645 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0b78b91c-f873-49e3-b01a-2f5d0413050e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:02.012614 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0b78b91c-f873-49e3-b01a-2f5d0413050e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:02.013187 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0b78b91c-f873-49e3-b01a-2f5d0413050e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:02.049435 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c2f9cc54-bb7f-40fa-ba6c-92133f8fbb00 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:02.061100 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c2f9cc54-bb7f-40fa-ba6c-92133f8fbb00 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.286637 Jul 19 09:28:02.075903 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 236/495] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:01 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:02.195101 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0b78b91c-f873-49e3-b01a-2f5d0413050e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:02.203702 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0b78b91c-f873-49e3-b01a-2f5d0413050e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1319 microversion: 2.1 time: 0.208523 Jul 19 09:28:02.210310 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 260/496] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:01 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:02.254614 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-14ecf966-b512-407d-a7b3-2306ce3258bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:02.255469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-14ecf966-b512-407d-a7b3-2306ce3258bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:02.264292 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14ecf966-b512-407d-a7b3-2306ce3258bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:02.265360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14ecf966-b512-407d-a7b3-2306ce3258bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:02.266394 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14ecf966-b512-407d-a7b3-2306ce3258bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:02.266924 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14ecf966-b512-407d-a7b3-2306ce3258bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:02.338817 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d68c9270-20cc-4941-976f-9cb1ebab5ee4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:02.339623 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d68c9270-20cc-4941-976f-9cb1ebab5ee4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:02.347546 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d68c9270-20cc-4941-976f-9cb1ebab5ee4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:02.348236 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d68c9270-20cc-4941-976f-9cb1ebab5ee4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:02.352908 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d68c9270-20cc-4941-976f-9cb1ebab5ee4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:02.353580 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d68c9270-20cc-4941-976f-9cb1ebab5ee4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:02.604536 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d68c9270-20cc-4941-976f-9cb1ebab5ee4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:02.614195 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d68c9270-20cc-4941-976f-9cb1ebab5ee4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:02.616021 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d68c9270-20cc-4941-976f-9cb1ebab5ee4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:02.617570 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d68c9270-20cc-4941-976f-9cb1ebab5ee4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1738 microversion: 2.20 time: 0.282813 Jul 19 09:28:02.618311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 261/497] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:02 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1738 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:28:02.648523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-769760de-ed4b-4419-bdf5-bfd0cb569d40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:02.649413 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-769760de-ed4b-4419-bdf5-bfd0cb569d40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:02.656344 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-769760de-ed4b-4419-bdf5-bfd0cb569d40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:02.656872 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-769760de-ed4b-4419-bdf5-bfd0cb569d40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:02.657883 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-769760de-ed4b-4419-bdf5-bfd0cb569d40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:02.658511 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-769760de-ed4b-4419-bdf5-bfd0cb569d40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:02.782782 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-14ecf966-b512-407d-a7b3-2306ce3258bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:02.795971 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-14ecf966-b512-407d-a7b3-2306ce3258bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1316 microversion: 2.1 time: 0.545421 Jul 19 09:28:02.797191 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 237/498] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:02 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1316 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:02.857804 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-769760de-ed4b-4419-bdf5-bfd0cb569d40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:02.865515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-769760de-ed4b-4419-bdf5-bfd0cb569d40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1259 microversion: 2.1 time: 0.220630 Jul 19 09:28:02.878883 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 262/499] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:02 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1259 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:02.907817 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-23d74e00-5cb8-4d10-9d0b-7ac53c27e094 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:02.908782 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-23d74e00-5cb8-4d10-9d0b-7ac53c27e094 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:02.919965 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-23d74e00-5cb8-4d10-9d0b-7ac53c27e094 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:02.921801 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-23d74e00-5cb8-4d10-9d0b-7ac53c27e094 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:02.923842 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-23d74e00-5cb8-4d10-9d0b-7ac53c27e094 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:02.924285 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-23d74e00-5cb8-4d10-9d0b-7ac53c27e094 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:03.080125 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5e5006c0-1a58-42fd-82bb-26ddb70b205d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:03.087821 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5e5006c0-1a58-42fd-82bb-26ddb70b205d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:03.095101 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5e5006c0-1a58-42fd-82bb-26ddb70b205d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:03.095978 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5e5006c0-1a58-42fd-82bb-26ddb70b205d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:03.097787 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5e5006c0-1a58-42fd-82bb-26ddb70b205d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:03.098432 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5e5006c0-1a58-42fd-82bb-26ddb70b205d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:03.193554 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-23d74e00-5cb8-4d10-9d0b-7ac53c27e094 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:03.202613 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-23d74e00-5cb8-4d10-9d0b-7ac53c27e094 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.298436 Jul 19 09:28:03.210478 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 238/500] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:02 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:03.220517 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d6f2b47f-150b-466d-96ac-ac9e6f33b225 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:03.221390 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d6f2b47f-150b-466d-96ac-ac9e6f33b225 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:03.228241 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d6f2b47f-150b-466d-96ac-ac9e6f33b225 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:03.229013 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d6f2b47f-150b-466d-96ac-ac9e6f33b225 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:03.230229 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d6f2b47f-150b-466d-96ac-ac9e6f33b225 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:03.230827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d6f2b47f-150b-466d-96ac-ac9e6f33b225 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:03.292799 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5e5006c0-1a58-42fd-82bb-26ddb70b205d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:03.301496 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5e5006c0-1a58-42fd-82bb-26ddb70b205d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.225366 Jul 19 09:28:03.310917 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 263/501] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:03 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:03.584915 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d6f2b47f-150b-466d-96ac-ac9e6f33b225 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:03.593250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d6f2b47f-150b-466d-96ac-ac9e6f33b225 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1319 microversion: 2.1 time: 0.376588 Jul 19 09:28:03.593941 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 239/502] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:03 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:28:03.637109 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6995494a-f171-4782-bea5-c2294db6ba1f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:03.638504 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6995494a-f171-4782-bea5-c2294db6ba1f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:03.646153 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6995494a-f171-4782-bea5-c2294db6ba1f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:03.646615 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6995494a-f171-4782-bea5-c2294db6ba1f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:03.650940 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6995494a-f171-4782-bea5-c2294db6ba1f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:03.651427 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6995494a-f171-4782-bea5-c2294db6ba1f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:03.819985 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0d653c75-8784-4fb3-8a5b-57b66089b6d5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:03.821683 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0d653c75-8784-4fb3-8a5b-57b66089b6d5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:03.827778 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0d653c75-8784-4fb3-8a5b-57b66089b6d5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:03.829257 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0d653c75-8784-4fb3-8a5b-57b66089b6d5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:03.830113 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0d653c75-8784-4fb3-8a5b-57b66089b6d5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:03.830615 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0d653c75-8784-4fb3-8a5b-57b66089b6d5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:03.830727 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6995494a-f171-4782-bea5-c2294db6ba1f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:03.844308 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6995494a-f171-4782-bea5-c2294db6ba1f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:03.846102 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6995494a-f171-4782-bea5-c2294db6ba1f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:03.847508 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6995494a-f171-4782-bea5-c2294db6ba1f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1738 microversion: 2.20 time: 0.214124 Jul 19 09:28:03.848066 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 264/503] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:03 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:03.884761 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8b473671-80a3-44da-9fc4-09485107db99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:03.885691 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8b473671-80a3-44da-9fc4-09485107db99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:03.896716 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8b473671-80a3-44da-9fc4-09485107db99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:03.897164 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8b473671-80a3-44da-9fc4-09485107db99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:03.898153 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8b473671-80a3-44da-9fc4-09485107db99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:03.898788 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8b473671-80a3-44da-9fc4-09485107db99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:03.997038 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0d653c75-8784-4fb3-8a5b-57b66089b6d5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:04.005588 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0d653c75-8784-4fb3-8a5b-57b66089b6d5 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1316 microversion: 2.1 time: 0.189652 Jul 19 09:28:04.018287 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 240/504] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:03 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1316 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:04.067127 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8b473671-80a3-44da-9fc4-09485107db99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:04.075029 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8b473671-80a3-44da-9fc4-09485107db99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1443 microversion: 2.1 time: 0.195822 Jul 19 09:28:04.075655 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 265/505] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:03 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1443 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:04.091839 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7ac10ffe-0f57-49be-8237-432da5259d19 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:04.092463 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7ac10ffe-0f57-49be-8237-432da5259d19 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:04.099234 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ac10ffe-0f57-49be-8237-432da5259d19 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:04.099625 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ac10ffe-0f57-49be-8237-432da5259d19 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:04.100415 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ac10ffe-0f57-49be-8237-432da5259d19 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:04.100862 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ac10ffe-0f57-49be-8237-432da5259d19 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:04.225668 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-14cdcd50-47ea-4dbc-bb60-3693f60f2c54 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:04.226375 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-14cdcd50-47ea-4dbc-bb60-3693f60f2c54 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:04.232521 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14cdcd50-47ea-4dbc-bb60-3693f60f2c54 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:04.232970 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14cdcd50-47ea-4dbc-bb60-3693f60f2c54 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:04.233750 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14cdcd50-47ea-4dbc-bb60-3693f60f2c54 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:04.234387 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14cdcd50-47ea-4dbc-bb60-3693f60f2c54 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:04.264548 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7ac10ffe-0f57-49be-8237-432da5259d19 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:04.272963 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7ac10ffe-0f57-49be-8237-432da5259d19 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1443 microversion: 2.1 time: 0.184687 Jul 19 09:28:04.274142 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 241/506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:04 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1443 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:04.320780 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-38fa29b0-09df-4625-9e14-c00f7830a49c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:04.323373 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-38fa29b0-09df-4625-9e14-c00f7830a49c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:04.336056 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-38fa29b0-09df-4625-9e14-c00f7830a49c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:04.338276 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-38fa29b0-09df-4625-9e14-c00f7830a49c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:04.340472 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-38fa29b0-09df-4625-9e14-c00f7830a49c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:04.340472 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-38fa29b0-09df-4625-9e14-c00f7830a49c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:04.413256 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-14cdcd50-47ea-4dbc-bb60-3693f60f2c54 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:04.421695 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-14cdcd50-47ea-4dbc-bb60-3693f60f2c54 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.199894 Jul 19 09:28:04.422504 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 266/507] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:04 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:04.554251 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-38fa29b0-09df-4625-9e14-c00f7830a49c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:04.568224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-38fa29b0-09df-4625-9e14-c00f7830a49c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.250766 Jul 19 09:28:04.573379 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 242/508] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:04 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:04.609364 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-41cdc99d-0ecc-4fbc-8315-e6bef38b9779 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:04.610066 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-41cdc99d-0ecc-4fbc-8315-e6bef38b9779 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:04.620645 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-41cdc99d-0ecc-4fbc-8315-e6bef38b9779 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:04.621380 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-41cdc99d-0ecc-4fbc-8315-e6bef38b9779 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:04.622040 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-41cdc99d-0ecc-4fbc-8315-e6bef38b9779 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:04.622434 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-41cdc99d-0ecc-4fbc-8315-e6bef38b9779 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:04.857066 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-41cdc99d-0ecc-4fbc-8315-e6bef38b9779 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:04.865450 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-41cdc99d-0ecc-4fbc-8315-e6bef38b9779 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1319 microversion: 2.1 time: 0.259610 Jul 19 09:28:04.866039 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 267/509] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:04 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:04.869863 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b17052ab-d9ee-42af-9dfd-068b87049080 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:04.871132 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b17052ab-d9ee-42af-9dfd-068b87049080 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:04.881495 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b17052ab-d9ee-42af-9dfd-068b87049080 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:04.883414 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b17052ab-d9ee-42af-9dfd-068b87049080 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:04.886872 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b17052ab-d9ee-42af-9dfd-068b87049080 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:04.887564 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b17052ab-d9ee-42af-9dfd-068b87049080 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:05.034454 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7fb1e995-49a3-40ae-affb-a1f3050f00ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:05.035117 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7fb1e995-49a3-40ae-affb-a1f3050f00ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:05.043357 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7fb1e995-49a3-40ae-affb-a1f3050f00ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:05.043808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7fb1e995-49a3-40ae-affb-a1f3050f00ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:05.044668 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7fb1e995-49a3-40ae-affb-a1f3050f00ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:05.049774 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7fb1e995-49a3-40ae-affb-a1f3050f00ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:05.123701 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b17052ab-d9ee-42af-9dfd-068b87049080 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:05.135472 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b17052ab-d9ee-42af-9dfd-068b87049080 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:05.137180 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b17052ab-d9ee-42af-9dfd-068b87049080 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:05.138525 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b17052ab-d9ee-42af-9dfd-068b87049080 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1738 microversion: 2.20 time: 0.276618 Jul 19 09:28:05.149937 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 243/510] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:04 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1738 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:28:05.155979 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-f407a6df-9774-457d-8f43-ebc1725a9567 req-8bd04856-731d-46b4-bfdf-10be8d04f1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36be7eb9-715d-4855-9896-49929b6d5013", "name": "network-vif-plugged", "status": "completed", "tag": "0945ccd4-7d3c-4acc-a559-260dab74f7fe"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:28:05.157851 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:28:05.157851 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:28:05.167684 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-f407a6df-9774-457d-8f43-ebc1725a9567 req-8bd04856-731d-46b4-bfdf-10be8d04f1c3 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:05.168519 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-f407a6df-9774-457d-8f43-ebc1725a9567 req-8bd04856-731d-46b4-bfdf-10be8d04f1c3 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:05.184403 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-f407a6df-9774-457d-8f43-ebc1725a9567 req-8bd04856-731d-46b4-bfdf-10be8d04f1c3 service nova] Creating event network-vif-plugged:0945ccd4-7d3c-4acc-a559-260dab74f7fe for instance 36be7eb9-715d-4855-9896-49929b6d5013 on hv-cinder-79338 Jul 19 09:28:05.194843 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-f407a6df-9774-457d-8f43-ebc1725a9567 req-8bd04856-731d-46b4-bfdf-10be8d04f1c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042646 Jul 19 09:28:05.195646 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 244/511] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:28:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:28:05.439966 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d729b75e-5d5c-40d7-8989-e511c31e5e53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:05.441289 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d729b75e-5d5c-40d7-8989-e511c31e5e53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:05.450973 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d729b75e-5d5c-40d7-8989-e511c31e5e53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:05.451783 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d729b75e-5d5c-40d7-8989-e511c31e5e53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:05.452785 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d729b75e-5d5c-40d7-8989-e511c31e5e53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:05.453235 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d729b75e-5d5c-40d7-8989-e511c31e5e53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:05.569412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7fb1e995-49a3-40ae-affb-a1f3050f00ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:05.576550 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7fb1e995-49a3-40ae-affb-a1f3050f00ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1316 microversion: 2.1 time: 0.546413 Jul 19 09:28:05.577113 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 268/512] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:05 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:05.590758 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-75ef441f-00f7-459a-82b5-2ceaed5dfb62 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:05.591392 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-75ef441f-00f7-459a-82b5-2ceaed5dfb62 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:05.605143 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75ef441f-00f7-459a-82b5-2ceaed5dfb62 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:05.605143 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75ef441f-00f7-459a-82b5-2ceaed5dfb62 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:05.605644 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75ef441f-00f7-459a-82b5-2ceaed5dfb62 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:05.606128 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75ef441f-00f7-459a-82b5-2ceaed5dfb62 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:05.636273 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d729b75e-5d5c-40d7-8989-e511c31e5e53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:05.651847 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d729b75e-5d5c-40d7-8989-e511c31e5e53 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.216610 Jul 19 09:28:05.661295 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 245/513] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:05 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:05.876758 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-75ef441f-00f7-459a-82b5-2ceaed5dfb62 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:05.882301 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5c97af5d-0274-418e-8446-9bc105f598bc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:05.882916 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5c97af5d-0274-418e-8446-9bc105f598bc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:05.887470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-75ef441f-00f7-459a-82b5-2ceaed5dfb62 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.306007 Jul 19 09:28:05.897872 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 269/514] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:05 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:05.901030 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c97af5d-0274-418e-8446-9bc105f598bc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:05.901749 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c97af5d-0274-418e-8446-9bc105f598bc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:05.902576 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c97af5d-0274-418e-8446-9bc105f598bc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:05.903388 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c97af5d-0274-418e-8446-9bc105f598bc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:06.067842 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5c97af5d-0274-418e-8446-9bc105f598bc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:06.076048 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5c97af5d-0274-418e-8446-9bc105f598bc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1319 microversion: 2.1 time: 0.197773 Jul 19 09:28:06.088083 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 246/515] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:05 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:06.156997 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f0b0ee25-9811-4e8c-b69f-be826b51161f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:06.157925 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f0b0ee25-9811-4e8c-b69f-be826b51161f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:06.165042 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f0b0ee25-9811-4e8c-b69f-be826b51161f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:06.165769 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f0b0ee25-9811-4e8c-b69f-be826b51161f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:06.166922 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f0b0ee25-9811-4e8c-b69f-be826b51161f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:06.167514 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f0b0ee25-9811-4e8c-b69f-be826b51161f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:06.422546 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f0b0ee25-9811-4e8c-b69f-be826b51161f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:06.433155 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f0b0ee25-9811-4e8c-b69f-be826b51161f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:06.434851 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f0b0ee25-9811-4e8c-b69f-be826b51161f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:06.436382 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f0b0ee25-9811-4e8c-b69f-be826b51161f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1738 microversion: 2.20 time: 0.283307 Jul 19 09:28:06.437509 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 270/516] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:06 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1738 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:06.594539 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-01a7f3e6-3a65-49aa-9e53-0e758f60f58a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:06.595627 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-01a7f3e6-3a65-49aa-9e53-0e758f60f58a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:06.603338 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-01a7f3e6-3a65-49aa-9e53-0e758f60f58a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:06.604434 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-01a7f3e6-3a65-49aa-9e53-0e758f60f58a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:06.605465 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-01a7f3e6-3a65-49aa-9e53-0e758f60f58a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:06.606118 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-01a7f3e6-3a65-49aa-9e53-0e758f60f58a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:06.669717 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-da11050b-b941-4e82-a1fe-6dbfcf23c111 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:06.670350 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-da11050b-b941-4e82-a1fe-6dbfcf23c111 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:06.683151 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da11050b-b941-4e82-a1fe-6dbfcf23c111 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:06.684010 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da11050b-b941-4e82-a1fe-6dbfcf23c111 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:06.685066 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da11050b-b941-4e82-a1fe-6dbfcf23c111 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:06.687858 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da11050b-b941-4e82-a1fe-6dbfcf23c111 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:06.794067 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-01a7f3e6-3a65-49aa-9e53-0e758f60f58a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:06.808167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-01a7f3e6-3a65-49aa-9e53-0e758f60f58a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1316 microversion: 2.1 time: 0.217515 Jul 19 09:28:06.810535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 247/517] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:06 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:06.905284 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-86d77dae-bffa-4fc5-91a0-e6f4b1ab089d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:06.906887 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-86d77dae-bffa-4fc5-91a0-e6f4b1ab089d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:06.913058 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86d77dae-bffa-4fc5-91a0-e6f4b1ab089d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:06.913525 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86d77dae-bffa-4fc5-91a0-e6f4b1ab089d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:06.914442 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86d77dae-bffa-4fc5-91a0-e6f4b1ab089d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:06.914722 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86d77dae-bffa-4fc5-91a0-e6f4b1ab089d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:07.049558 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-da11050b-b941-4e82-a1fe-6dbfcf23c111 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:07.058678 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-da11050b-b941-4e82-a1fe-6dbfcf23c111 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.393660 Jul 19 09:28:07.062152 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 271/518] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:06 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:07.087427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-86d77dae-bffa-4fc5-91a0-e6f4b1ab089d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:07.096651 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5c629b9e-24b9-46c3-a613-f9ca5e419f1d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:07.097709 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5c629b9e-24b9-46c3-a613-f9ca5e419f1d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:07.100579 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-86d77dae-bffa-4fc5-91a0-e6f4b1ab089d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.199414 Jul 19 09:28:07.106273 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5c629b9e-24b9-46c3-a613-f9ca5e419f1d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:07.107111 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5c629b9e-24b9-46c3-a613-f9ca5e419f1d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:07.108136 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5c629b9e-24b9-46c3-a613-f9ca5e419f1d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:07.108863 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5c629b9e-24b9-46c3-a613-f9ca5e419f1d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:07.111106 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 248/519] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:06 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:07.427147 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5c629b9e-24b9-46c3-a613-f9ca5e419f1d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:07.435858 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5c629b9e-24b9-46c3-a613-f9ca5e419f1d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1319 microversion: 2.1 time: 0.343959 Jul 19 09:28:07.436675 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 272/520] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:07 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:07.460429 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5bde7821-1f0a-4f06-b483-adeb13965c9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:07.461124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5bde7821-1f0a-4f06-b483-adeb13965c9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:07.472865 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5bde7821-1f0a-4f06-b483-adeb13965c9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:07.473319 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5bde7821-1f0a-4f06-b483-adeb13965c9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:07.474295 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5bde7821-1f0a-4f06-b483-adeb13965c9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:07.474897 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5bde7821-1f0a-4f06-b483-adeb13965c9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:07.523487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-7ef01eb1-929e-4e47-986e-04e2b494e4d6 req-8dcfe325-2211-420a-b413-5f35be563d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee02e36e-7587-4ab3-b367-08e1c9b26c69", "tag": "8c6fc9b0-949b-4965-80e0-e84ca522d2a6"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:28:07.523487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:28:07.523487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:28:07.537442 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-7ef01eb1-929e-4e47-986e-04e2b494e4d6 req-8dcfe325-2211-420a-b413-5f35be563d12 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:07.538314 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-7ef01eb1-929e-4e47-986e-04e2b494e4d6 req-8dcfe325-2211-420a-b413-5f35be563d12 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:07.551396 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-7ef01eb1-929e-4e47-986e-04e2b494e4d6 req-8dcfe325-2211-420a-b413-5f35be563d12 service nova] Creating event network-changed:8c6fc9b0-949b-4965-80e0-e84ca522d2a6 for instance ee02e36e-7587-4ab3-b367-08e1c9b26c69 on hv-cinder-79338 Jul 19 09:28:07.557192 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-7ef01eb1-929e-4e47-986e-04e2b494e4d6 req-8dcfe325-2211-420a-b413-5f35be563d12 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039082 Jul 19 09:28:07.558482 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 273/521] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:28:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 09:28:07.729535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5bde7821-1f0a-4f06-b483-adeb13965c9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:07.738846 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5bde7821-1f0a-4f06-b483-adeb13965c9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:07.746912 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5bde7821-1f0a-4f06-b483-adeb13965c9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:07.748471 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5bde7821-1f0a-4f06-b483-adeb13965c9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1738 microversion: 2.20 time: 0.297188 Jul 19 09:28:07.749587 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 249/522] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:07 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1738 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:07.825905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8d0f7f9f-62a5-434b-a34b-0e2d4c356698 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:07.826968 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8d0f7f9f-62a5-434b-a34b-0e2d4c356698 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:07.834852 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d0f7f9f-62a5-434b-a34b-0e2d4c356698 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:07.837097 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d0f7f9f-62a5-434b-a34b-0e2d4c356698 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:07.844953 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d0f7f9f-62a5-434b-a34b-0e2d4c356698 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:07.845235 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d0f7f9f-62a5-434b-a34b-0e2d4c356698 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:08.058971 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8d0f7f9f-62a5-434b-a34b-0e2d4c356698 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:08.069759 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8d0f7f9f-62a5-434b-a34b-0e2d4c356698 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1316 microversion: 2.1 time: 0.247820 Jul 19 09:28:08.074326 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 274/523] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:07 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:08.077616 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-16e1e244-9101-4ac9-a0d1-a7671a5f916b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:08.078790 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-16e1e244-9101-4ac9-a0d1-a7671a5f916b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:08.086356 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-16e1e244-9101-4ac9-a0d1-a7671a5f916b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:08.087071 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-16e1e244-9101-4ac9-a0d1-a7671a5f916b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:08.088022 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-16e1e244-9101-4ac9-a0d1-a7671a5f916b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:08.088616 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-16e1e244-9101-4ac9-a0d1-a7671a5f916b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:08.117566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c848d2ba-87bc-4b2a-aba1-9d465256c507 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:08.118794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c848d2ba-87bc-4b2a-aba1-9d465256c507 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:08.126794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c848d2ba-87bc-4b2a-aba1-9d465256c507 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:08.128924 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c848d2ba-87bc-4b2a-aba1-9d465256c507 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:08.131268 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c848d2ba-87bc-4b2a-aba1-9d465256c507 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:08.131794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c848d2ba-87bc-4b2a-aba1-9d465256c507 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:08.369603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c848d2ba-87bc-4b2a-aba1-9d465256c507 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:08.380317 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c848d2ba-87bc-4b2a-aba1-9d465256c507 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1721 microversion: 2.1 time: 0.266423 Jul 19 09:28:08.381649 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 275/524] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:08 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:08.425161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-16e1e244-9101-4ac9-a0d1-a7671a5f916b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:08.434755 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-16e1e244-9101-4ac9-a0d1-a7671a5f916b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.360878 Jul 19 09:28:08.435362 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 250/525] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:08 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:08.454829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3a031387-6a6c-41dd-b091-a44c238c1502 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:08.455546 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3a031387-6a6c-41dd-b091-a44c238c1502 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:08.464797 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3a031387-6a6c-41dd-b091-a44c238c1502 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:08.467252 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3a031387-6a6c-41dd-b091-a44c238c1502 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:08.467942 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3a031387-6a6c-41dd-b091-a44c238c1502 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:08.468407 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3a031387-6a6c-41dd-b091-a44c238c1502 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:08.682480 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3a031387-6a6c-41dd-b091-a44c238c1502 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:08.698237 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3a031387-6a6c-41dd-b091-a44c238c1502 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1508 microversion: 2.1 time: 0.249299 Jul 19 09:28:08.699276 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 276/526] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:08 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:08.716240 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ec28c853-b36d-483a-8c89-13c57ee92995 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "956e0791-2a92-44c6-9e30-290abe9a4696", "device": "/dev/sdb"}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:28:08.717501 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ec28c853-b36d-483a-8c89-13c57ee92995 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:08.728713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec28c853-b36d-483a-8c89-13c57ee92995 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:08.730719 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec28c853-b36d-483a-8c89-13c57ee92995 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:08.734644 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec28c853-b36d-483a-8c89-13c57ee92995 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:08.734644 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec28c853-b36d-483a-8c89-13c57ee92995 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:08.766822 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bf478d46-6761-4daf-b90e-edb76352a1b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:08.767446 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bf478d46-6761-4daf-b90e-edb76352a1b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:08.774946 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bf478d46-6761-4daf-b90e-edb76352a1b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:08.775455 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bf478d46-6761-4daf-b90e-edb76352a1b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:08.776239 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bf478d46-6761-4daf-b90e-edb76352a1b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:08.777092 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bf478d46-6761-4daf-b90e-edb76352a1b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:09.026948 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bf478d46-6761-4daf-b90e-edb76352a1b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:09.037816 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bf478d46-6761-4daf-b90e-edb76352a1b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:09.039659 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bf478d46-6761-4daf-b90e-edb76352a1b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:09.040951 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bf478d46-6761-4daf-b90e-edb76352a1b8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1738 microversion: 2.20 time: 0.277941 Jul 19 09:28:09.053289 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 277/527] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:08 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1738 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:28:09.058414 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-5b9109f1-aeb6-4f84-bd0b-990d6ea16deb req-8610c87b-8ec4-4cc5-bfb7-86988eed3fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5684c14-21c0-4aeb-9ca6-9df7ae3111f8", "name": "network-vif-plugged", "status": "completed", "tag": "16feefe3-38f0-490f-bae0-554b20fb320b"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:28:09.060297 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:28:09.060297 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:28:09.074354 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-5b9109f1-aeb6-4f84-bd0b-990d6ea16deb req-8610c87b-8ec4-4cc5-bfb7-86988eed3fc0 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:09.076074 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-5b9109f1-aeb6-4f84-bd0b-990d6ea16deb req-8610c87b-8ec4-4cc5-bfb7-86988eed3fc0 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:09.100881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ec28c853-b36d-483a-8c89-13c57ee92995 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "POST /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389567 Jul 19 09:28:09.106674 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 251/528] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Jul 19 09:28:08 2021] POST /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:28:09.113360 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-5b9109f1-aeb6-4f84-bd0b-990d6ea16deb req-8610c87b-8ec4-4cc5-bfb7-86988eed3fc0 service nova] Creating event network-vif-plugged:16feefe3-38f0-490f-bae0-554b20fb320b for instance a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 on hv-cinder-79338 Jul 19 09:28:09.117828 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3e3e7b9a-afb6-4f95-8c65-4de543267dc1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:09.119701 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3e3e7b9a-afb6-4f95-8c65-4de543267dc1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:09.127545 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-5b9109f1-aeb6-4f84-bd0b-990d6ea16deb req-8610c87b-8ec4-4cc5-bfb7-86988eed3fc0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072837 Jul 19 09:28:09.128493 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 278/529] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:28:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:28:09.131313 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e3e7b9a-afb6-4f95-8c65-4de543267dc1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:09.132013 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e3e7b9a-afb6-4f95-8c65-4de543267dc1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:09.133112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e3e7b9a-afb6-4f95-8c65-4de543267dc1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:09.133712 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e3e7b9a-afb6-4f95-8c65-4de543267dc1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:09.396041 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3e3e7b9a-afb6-4f95-8c65-4de543267dc1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:09.398613 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-add7f232-125e-42f6-8e14-bebf8b76be28 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:09.399723 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-add7f232-125e-42f6-8e14-bebf8b76be28 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:09.404662 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3e3e7b9a-afb6-4f95-8c65-4de543267dc1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1316 microversion: 2.1 time: 0.296574 Jul 19 09:28:09.406335 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 252/530] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:09 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:09.415729 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-add7f232-125e-42f6-8e14-bebf8b76be28 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:09.417349 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-add7f232-125e-42f6-8e14-bebf8b76be28 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:09.418507 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-add7f232-125e-42f6-8e14-bebf8b76be28 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:09.419139 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-add7f232-125e-42f6-8e14-bebf8b76be28 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:09.452876 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-280a69f7-1bcf-4598-a98b-a0cb1955cd2f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:09.453908 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-280a69f7-1bcf-4598-a98b-a0cb1955cd2f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:09.464110 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-280a69f7-1bcf-4598-a98b-a0cb1955cd2f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:09.464889 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-280a69f7-1bcf-4598-a98b-a0cb1955cd2f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:09.465987 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-280a69f7-1bcf-4598-a98b-a0cb1955cd2f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:09.466619 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-280a69f7-1bcf-4598-a98b-a0cb1955cd2f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:09.584878 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-add7f232-125e-42f6-8e14-bebf8b76be28 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:09.594109 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-add7f232-125e-42f6-8e14-bebf8b76be28 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1698 microversion: 2.1 time: 0.199820 Jul 19 09:28:09.595099 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 279/531] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:09 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1698 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:09.611485 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d137f722-b518-40cc-8bd3-0a5326da3f57 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:28:09.620012 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d137f722-b518-40cc-8bd3-0a5326da3f57 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:09.620748 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d137f722-b518-40cc-8bd3-0a5326da3f57 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:09.652710 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d137f722-b518-40cc-8bd3-0a5326da3f57 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Going to try to start instance {{(pid=107463) start /opt/stack/nova/nova/compute/api.py:2605}} Jul 19 09:28:09.653450 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-280a69f7-1bcf-4598-a98b-a0cb1955cd2f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:09.668029 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-280a69f7-1bcf-4598-a98b-a0cb1955cd2f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.219689 Jul 19 09:28:09.669039 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 253/532] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:09 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:09.700799 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d137f722-b518-40cc-8bd3-0a5326da3f57 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action" status: 202 len: 0 microversion: 2.1 time: 0.092973 Jul 19 09:28:09.704596 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 280/533] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:28:09 2021] POST /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:28:09.709675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ae4c4e44-6577-4fd4-811b-42bc8b6312da tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:09.710306 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ae4c4e44-6577-4fd4-811b-42bc8b6312da tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:09.716314 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ae4c4e44-6577-4fd4-811b-42bc8b6312da tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:09.717019 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ae4c4e44-6577-4fd4-811b-42bc8b6312da tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:09.717969 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ae4c4e44-6577-4fd4-811b-42bc8b6312da tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:09.718563 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ae4c4e44-6577-4fd4-811b-42bc8b6312da tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:09.871730 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ae4c4e44-6577-4fd4-811b-42bc8b6312da tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:09.880038 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ae4c4e44-6577-4fd4-811b-42bc8b6312da tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1707 microversion: 2.1 time: 0.174026 Jul 19 09:28:09.881402 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 254/534] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:09 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1707 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:10.060475 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e5ad1456-19c5-438d-ab4d-264079865631 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:10.061959 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e5ad1456-19c5-438d-ab4d-264079865631 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:10.069964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e5ad1456-19c5-438d-ab4d-264079865631 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:10.070660 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e5ad1456-19c5-438d-ab4d-264079865631 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:10.071896 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e5ad1456-19c5-438d-ab4d-264079865631 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:10.072566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e5ad1456-19c5-438d-ab4d-264079865631 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:10.304595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e5ad1456-19c5-438d-ab4d-264079865631 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:10.315789 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e5ad1456-19c5-438d-ab4d-264079865631 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:10.317800 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e5ad1456-19c5-438d-ab4d-264079865631 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:10.319412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e5ad1456-19c5-438d-ab4d-264079865631 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1738 microversion: 2.20 time: 0.262686 Jul 19 09:28:10.323309 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 281/535] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:10 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:10.423503 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b95fc43f-0b7a-454b-8262-c9d7fe5c9417 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:10.425085 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b95fc43f-0b7a-454b-8262-c9d7fe5c9417 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:10.432056 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b95fc43f-0b7a-454b-8262-c9d7fe5c9417 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:10.432506 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b95fc43f-0b7a-454b-8262-c9d7fe5c9417 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:10.433314 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b95fc43f-0b7a-454b-8262-c9d7fe5c9417 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:10.433751 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b95fc43f-0b7a-454b-8262-c9d7fe5c9417 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:10.644244 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b95fc43f-0b7a-454b-8262-c9d7fe5c9417 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:10.652066 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b95fc43f-0b7a-454b-8262-c9d7fe5c9417 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1316 microversion: 2.1 time: 0.233805 Jul 19 09:28:10.652649 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 255/536] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:10 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:10.685463 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0ea1d26a-0c8d-4f4d-8a65-eafb4981cede tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:10.686029 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0ea1d26a-0c8d-4f4d-8a65-eafb4981cede tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:10.692907 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0ea1d26a-0c8d-4f4d-8a65-eafb4981cede tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:10.693355 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0ea1d26a-0c8d-4f4d-8a65-eafb4981cede tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:10.694147 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0ea1d26a-0c8d-4f4d-8a65-eafb4981cede tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:10.694614 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0ea1d26a-0c8d-4f4d-8a65-eafb4981cede tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:10.840331 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0ea1d26a-0c8d-4f4d-8a65-eafb4981cede tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:10.848036 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0ea1d26a-0c8d-4f4d-8a65-eafb4981cede tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.166388 Jul 19 09:28:10.848597 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 282/537] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:10 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:10.897512 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-264a637e-cdc0-48bf-8939-62957e39f4c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:10.898080 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-264a637e-cdc0-48bf-8939-62957e39f4c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:10.908449 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-264a637e-cdc0-48bf-8939-62957e39f4c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:10.908924 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-264a637e-cdc0-48bf-8939-62957e39f4c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:10.927789 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-264a637e-cdc0-48bf-8939-62957e39f4c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:10.928258 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-264a637e-cdc0-48bf-8939-62957e39f4c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:11.113711 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-264a637e-cdc0-48bf-8939-62957e39f4c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:11.126285 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-264a637e-cdc0-48bf-8939-62957e39f4c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1707 microversion: 2.1 time: 0.232497 Jul 19 09:28:11.127305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 256/538] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:10 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1707 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:11.339971 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-103a2ffa-f00f-46f5-9b76-f126b60865df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:11.340639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-103a2ffa-f00f-46f5-9b76-f126b60865df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:11.347247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-103a2ffa-f00f-46f5-9b76-f126b60865df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:11.347771 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-103a2ffa-f00f-46f5-9b76-f126b60865df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:11.348639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-103a2ffa-f00f-46f5-9b76-f126b60865df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:11.349131 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-103a2ffa-f00f-46f5-9b76-f126b60865df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:11.495995 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-103a2ffa-f00f-46f5-9b76-f126b60865df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:11.503456 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-103a2ffa-f00f-46f5-9b76-f126b60865df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:11.504958 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-103a2ffa-f00f-46f5-9b76-f126b60865df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:11.506087 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-103a2ffa-f00f-46f5-9b76-f126b60865df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1738 microversion: 2.20 time: 0.170254 Jul 19 09:28:11.506756 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 283/539] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:11 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:11.674390 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-12e4a1df-74f2-4d5a-992d-3cf5f86e6ddf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:11.674981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-12e4a1df-74f2-4d5a-992d-3cf5f86e6ddf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:11.680764 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12e4a1df-74f2-4d5a-992d-3cf5f86e6ddf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:11.681204 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12e4a1df-74f2-4d5a-992d-3cf5f86e6ddf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:11.681963 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12e4a1df-74f2-4d5a-992d-3cf5f86e6ddf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:11.682398 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12e4a1df-74f2-4d5a-992d-3cf5f86e6ddf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:11.816418 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-12e4a1df-74f2-4d5a-992d-3cf5f86e6ddf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:11.823556 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-12e4a1df-74f2-4d5a-992d-3cf5f86e6ddf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1505 microversion: 2.1 time: 0.152765 Jul 19 09:28:11.824121 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 257/540] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:11 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:11.864529 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-75eb6db7-2f8d-4692-ad28-4e43c1c160cd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:11.865269 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-75eb6db7-2f8d-4692-ad28-4e43c1c160cd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:11.872557 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75eb6db7-2f8d-4692-ad28-4e43c1c160cd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:11.873096 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75eb6db7-2f8d-4692-ad28-4e43c1c160cd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:11.873946 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75eb6db7-2f8d-4692-ad28-4e43c1c160cd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:11.874457 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75eb6db7-2f8d-4692-ad28-4e43c1c160cd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:12.018424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-75eb6db7-2f8d-4692-ad28-4e43c1c160cd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:12.026544 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-75eb6db7-2f8d-4692-ad28-4e43c1c160cd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.165705 Jul 19 09:28:12.027260 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 284/541] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:11 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:12.143157 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-40a235e8-2097-4132-9b8b-f53bb20c1bb4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:12.143802 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-40a235e8-2097-4132-9b8b-f53bb20c1bb4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:12.149682 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-40a235e8-2097-4132-9b8b-f53bb20c1bb4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:12.150145 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-40a235e8-2097-4132-9b8b-f53bb20c1bb4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:12.150923 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-40a235e8-2097-4132-9b8b-f53bb20c1bb4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:12.151398 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-40a235e8-2097-4132-9b8b-f53bb20c1bb4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:12.287146 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-40a235e8-2097-4132-9b8b-f53bb20c1bb4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:12.295245 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-40a235e8-2097-4132-9b8b-f53bb20c1bb4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1711 microversion: 2.1 time: 0.155759 Jul 19 09:28:12.295808 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 258/542] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:12 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1711 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:12.523881 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d52cb21d-4a6f-41d6-8107-ccbcbb29839b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:12.524594 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d52cb21d-4a6f-41d6-8107-ccbcbb29839b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:12.530383 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d52cb21d-4a6f-41d6-8107-ccbcbb29839b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:12.530831 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d52cb21d-4a6f-41d6-8107-ccbcbb29839b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:12.531622 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d52cb21d-4a6f-41d6-8107-ccbcbb29839b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:12.532057 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d52cb21d-4a6f-41d6-8107-ccbcbb29839b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:12.665368 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d52cb21d-4a6f-41d6-8107-ccbcbb29839b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:12.673413 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d52cb21d-4a6f-41d6-8107-ccbcbb29839b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:12.675072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d52cb21d-4a6f-41d6-8107-ccbcbb29839b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:12.676191 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d52cb21d-4a6f-41d6-8107-ccbcbb29839b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1720 microversion: 2.20 time: 0.156131 Jul 19 09:28:12.676744 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 285/543] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:12 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:28:13.043827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d8e42823-7f22-425a-98bf-be98e310af9a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:13.044438 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d8e42823-7f22-425a-98bf-be98e310af9a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:13.051425 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d8e42823-7f22-425a-98bf-be98e310af9a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:13.051888 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d8e42823-7f22-425a-98bf-be98e310af9a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:13.052661 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d8e42823-7f22-425a-98bf-be98e310af9a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:13.053102 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d8e42823-7f22-425a-98bf-be98e310af9a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:13.169662 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1e06b82b-22d1-4f55-aa3f-98be4203a82a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d515f9f3-cf05-4226-8186-c9e6317f6ac6"}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:28:13.170790 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1e06b82b-22d1-4f55-aa3f-98be4203a82a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:13.177135 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e06b82b-22d1-4f55-aa3f-98be4203a82a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:13.177524 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e06b82b-22d1-4f55-aa3f-98be4203a82a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:13.178302 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e06b82b-22d1-4f55-aa3f-98be4203a82a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:13.178735 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e06b82b-22d1-4f55-aa3f-98be4203a82a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:13.186246 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d8e42823-7f22-425a-98bf-be98e310af9a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:13.194485 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d8e42823-7f22-425a-98bf-be98e310af9a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.154587 Jul 19 09:28:13.195061 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 259/544] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:13 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:13.419591 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1e06b82b-22d1-4f55-aa3f-98be4203a82a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "POST /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253742 Jul 19 09:28:13.420218 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 286/545] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Jul 19 09:28:13 2021] POST /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 09:28:13.694193 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-20e6232b-42c6-4bf4-a2fe-5f6a5e29098f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:13.694730 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-20e6232b-42c6-4bf4-a2fe-5f6a5e29098f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:13.700445 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-20e6232b-42c6-4bf4-a2fe-5f6a5e29098f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:13.700889 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-20e6232b-42c6-4bf4-a2fe-5f6a5e29098f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:13.701646 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-20e6232b-42c6-4bf4-a2fe-5f6a5e29098f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:13.702074 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-20e6232b-42c6-4bf4-a2fe-5f6a5e29098f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:13.836885 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-20e6232b-42c6-4bf4-a2fe-5f6a5e29098f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:13.844422 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-20e6232b-42c6-4bf4-a2fe-5f6a5e29098f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:13.845917 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-20e6232b-42c6-4bf4-a2fe-5f6a5e29098f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:13.847085 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-20e6232b-42c6-4bf4-a2fe-5f6a5e29098f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1720 microversion: 2.20 time: 0.156600 Jul 19 09:28:13.847635 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 260/546] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:13 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:14.211561 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2d816393-b7f5-45a1-9b6c-6902d261b5f4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:14.212257 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2d816393-b7f5-45a1-9b6c-6902d261b5f4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:14.218369 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2d816393-b7f5-45a1-9b6c-6902d261b5f4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:14.218765 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2d816393-b7f5-45a1-9b6c-6902d261b5f4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:14.219548 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2d816393-b7f5-45a1-9b6c-6902d261b5f4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:14.219983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2d816393-b7f5-45a1-9b6c-6902d261b5f4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:14.350939 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2d816393-b7f5-45a1-9b6c-6902d261b5f4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:14.358500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2d816393-b7f5-45a1-9b6c-6902d261b5f4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.150988 Jul 19 09:28:14.359076 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 287/547] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:14 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:14.753693 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-0844a963-5c54-4725-a9f6-315e203ea2c3 req-de7ac013-442e-4949-9664-160398bc7842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cbcf278-5d96-4715-9238-5dd27d17311d", "name": "network-vif-unplugged", "status": "completed", "tag": "d8df4a87-cd9e-43a5-9d1d-ace9278bf484"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:28:14.755296 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:28:14.755296 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:28:14.762713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-0844a963-5c54-4725-a9f6-315e203ea2c3 req-de7ac013-442e-4949-9664-160398bc7842 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:14.763274 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-0844a963-5c54-4725-a9f6-315e203ea2c3 req-de7ac013-442e-4949-9664-160398bc7842 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:14.774637 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-0844a963-5c54-4725-a9f6-315e203ea2c3 req-de7ac013-442e-4949-9664-160398bc7842 service nova] Creating event network-vif-unplugged:d8df4a87-cd9e-43a5-9d1d-ace9278bf484 for instance 5cbcf278-5d96-4715-9238-5dd27d17311d on hv-cinder-79338 Jul 19 09:28:14.779402 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-0844a963-5c54-4725-a9f6-315e203ea2c3 req-de7ac013-442e-4949-9664-160398bc7842 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029796 Jul 19 09:28:14.780202 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 261/548] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:28:14 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:28:14.865520 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8f4a2bb0-edec-4c00-838d-44d7ae6d3999 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:14.866331 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8f4a2bb0-edec-4c00-838d-44d7ae6d3999 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:14.872038 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8f4a2bb0-edec-4c00-838d-44d7ae6d3999 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:14.872482 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8f4a2bb0-edec-4c00-838d-44d7ae6d3999 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:14.873231 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8f4a2bb0-edec-4c00-838d-44d7ae6d3999 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:14.873655 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8f4a2bb0-edec-4c00-838d-44d7ae6d3999 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:15.005179 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8f4a2bb0-edec-4c00-838d-44d7ae6d3999 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:15.012705 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8f4a2bb0-edec-4c00-838d-44d7ae6d3999 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:15.014190 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8f4a2bb0-edec-4c00-838d-44d7ae6d3999 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:15.015336 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8f4a2bb0-edec-4c00-838d-44d7ae6d3999 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1720 microversion: 2.20 time: 0.154098 Jul 19 09:28:15.015880 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 288/549] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:14 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:15.375764 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3bae2260-c595-4184-a34e-419074d3fbb1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:15.376395 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3bae2260-c595-4184-a34e-419074d3fbb1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:15.382430 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3bae2260-c595-4184-a34e-419074d3fbb1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:15.382892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3bae2260-c595-4184-a34e-419074d3fbb1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:15.383678 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3bae2260-c595-4184-a34e-419074d3fbb1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:15.384119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3bae2260-c595-4184-a34e-419074d3fbb1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:15.517227 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3bae2260-c595-4184-a34e-419074d3fbb1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:15.525416 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3bae2260-c595-4184-a34e-419074d3fbb1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.153694 Jul 19 09:28:15.525979 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 262/550] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:15 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:16.033256 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9db663c7-6ef6-4d7e-a783-b582cbe6f0cf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:16.033904 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9db663c7-6ef6-4d7e-a783-b582cbe6f0cf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:16.040238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9db663c7-6ef6-4d7e-a783-b582cbe6f0cf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:16.040702 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9db663c7-6ef6-4d7e-a783-b582cbe6f0cf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:16.041483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9db663c7-6ef6-4d7e-a783-b582cbe6f0cf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:16.042176 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9db663c7-6ef6-4d7e-a783-b582cbe6f0cf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:16.177068 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9db663c7-6ef6-4d7e-a783-b582cbe6f0cf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:16.184864 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9db663c7-6ef6-4d7e-a783-b582cbe6f0cf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:16.186342 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9db663c7-6ef6-4d7e-a783-b582cbe6f0cf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:16.187492 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9db663c7-6ef6-4d7e-a783-b582cbe6f0cf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1723 microversion: 2.20 time: 0.158128 Jul 19 09:28:16.188041 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 289/551] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:16 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:16.205065 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d6bbc7dd-241f-4a91-8c94-1eb755924ad8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "615754e5-4564-44ba-a138-8465684d2db4"}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:28:16.206680 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d6bbc7dd-241f-4a91-8c94-1eb755924ad8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:16.212396 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d6bbc7dd-241f-4a91-8c94-1eb755924ad8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:16.212839 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d6bbc7dd-241f-4a91-8c94-1eb755924ad8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:16.213592 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d6bbc7dd-241f-4a91-8c94-1eb755924ad8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:16.214019 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d6bbc7dd-241f-4a91-8c94-1eb755924ad8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:16.496791 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d6bbc7dd-241f-4a91-8c94-1eb755924ad8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295456 Jul 19 09:28:16.497461 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 263/552] 10.222.0.16 () {62 vars in 1364 bytes} [Mon Jul 19 09:28:16 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:28:16.541785 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-37022aa7-44e7-413b-b059-820f10811cac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:16.542421 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-37022aa7-44e7-413b-b059-820f10811cac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:16.555209 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37022aa7-44e7-413b-b059-820f10811cac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:16.555209 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37022aa7-44e7-413b-b059-820f10811cac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:16.555209 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37022aa7-44e7-413b-b059-820f10811cac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:16.555209 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37022aa7-44e7-413b-b059-820f10811cac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:16.562822 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-eb6b594c-c06e-4a61-aec4-1723876fb509 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:28:16.563407 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-eb6b594c-c06e-4a61-aec4-1723876fb509 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:16.570496 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eb6b594c-c06e-4a61-aec4-1723876fb509 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:16.570945 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eb6b594c-c06e-4a61-aec4-1723876fb509 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:16.571742 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eb6b594c-c06e-4a61-aec4-1723876fb509 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:16.572175 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eb6b594c-c06e-4a61-aec4-1723876fb509 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:16.654654 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-eb6b594c-c06e-4a61-aec4-1723876fb509 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action" status: 202 len: 0 microversion: 2.20 time: 0.095544 Jul 19 09:28:16.655584 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 264/553] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:28:16 2021] POST /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 19 09:28:16.663491 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e424eee5-fe91-44a2-933f-c78bb8749688 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:16.664249 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e424eee5-fe91-44a2-933f-c78bb8749688 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:16.670691 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e424eee5-fe91-44a2-933f-c78bb8749688 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:16.671208 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e424eee5-fe91-44a2-933f-c78bb8749688 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:16.672116 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e424eee5-fe91-44a2-933f-c78bb8749688 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:16.672558 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e424eee5-fe91-44a2-933f-c78bb8749688 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:16.715248 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-37022aa7-44e7-413b-b059-820f10811cac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:16.724567 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-37022aa7-44e7-413b-b059-820f10811cac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.186580 Jul 19 09:28:16.725815 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 290/554] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:16 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:16.836464 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e424eee5-fe91-44a2-933f-c78bb8749688 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:16.853767 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e424eee5-fe91-44a2-933f-c78bb8749688 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:16.857149 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e424eee5-fe91-44a2-933f-c78bb8749688 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:16.858173 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e424eee5-fe91-44a2-933f-c78bb8749688 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1749 microversion: 2.20 time: 0.198134 Jul 19 09:28:16.861651 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 265/555] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:16 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1749 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:17.741763 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ce2e7370-468a-4968-b639-61613758e204 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:17.742408 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ce2e7370-468a-4968-b639-61613758e204 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:17.748483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ce2e7370-468a-4968-b639-61613758e204 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:17.748938 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ce2e7370-468a-4968-b639-61613758e204 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:17.749708 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ce2e7370-468a-4968-b639-61613758e204 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:17.750146 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ce2e7370-468a-4968-b639-61613758e204 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:17.877376 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c549ce16-d091-4e69-9a7b-90c4a8755313 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:17.877901 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c549ce16-d091-4e69-9a7b-90c4a8755313 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:17.880963 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ce2e7370-468a-4968-b639-61613758e204 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:17.884403 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c549ce16-d091-4e69-9a7b-90c4a8755313 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:17.885057 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c549ce16-d091-4e69-9a7b-90c4a8755313 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:17.885834 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c549ce16-d091-4e69-9a7b-90c4a8755313 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:17.886269 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c549ce16-d091-4e69-9a7b-90c4a8755313 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:17.889679 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ce2e7370-468a-4968-b639-61613758e204 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.151531 Jul 19 09:28:17.890520 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 291/556] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:17 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:18.017957 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c549ce16-d091-4e69-9a7b-90c4a8755313 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:18.026057 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c549ce16-d091-4e69-9a7b-90c4a8755313 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:18.027622 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c549ce16-d091-4e69-9a7b-90c4a8755313 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:18.028801 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c549ce16-d091-4e69-9a7b-90c4a8755313 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155172 Jul 19 09:28:18.029357 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 266/557] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:17 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:28:18.906279 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cd400bf1-44b8-4730-9479-3e5383ba8ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:18.906893 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-cd400bf1-44b8-4730-9479-3e5383ba8ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:18.912799 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cd400bf1-44b8-4730-9479-3e5383ba8ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:18.913247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cd400bf1-44b8-4730-9479-3e5383ba8ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:18.913997 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cd400bf1-44b8-4730-9479-3e5383ba8ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:18.914426 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cd400bf1-44b8-4730-9479-3e5383ba8ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:19.046337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cd400bf1-44b8-4730-9479-3e5383ba8ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:19.047870 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1111f74a-94bd-4db1-a859-e250be30ce66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:19.048474 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1111f74a-94bd-4db1-a859-e250be30ce66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:19.054020 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-cd400bf1-44b8-4730-9479-3e5383ba8ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.151442 Jul 19 09:28:19.054149 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1111f74a-94bd-4db1-a859-e250be30ce66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:19.054576 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1111f74a-94bd-4db1-a859-e250be30ce66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:19.054713 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 292/558] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:18 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:19.055720 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1111f74a-94bd-4db1-a859-e250be30ce66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:19.056159 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1111f74a-94bd-4db1-a859-e250be30ce66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:19.192352 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1111f74a-94bd-4db1-a859-e250be30ce66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:19.200441 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1111f74a-94bd-4db1-a859-e250be30ce66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:19.201954 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1111f74a-94bd-4db1-a859-e250be30ce66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:19.203107 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1111f74a-94bd-4db1-a859-e250be30ce66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.158853 Jul 19 09:28:19.203668 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 267/559] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:19 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:28:20.071255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-44a89b95-bada-4e79-86ac-24a3cf8deb56 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:20.071800 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-44a89b95-bada-4e79-86ac-24a3cf8deb56 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:20.077460 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44a89b95-bada-4e79-86ac-24a3cf8deb56 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:20.077906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44a89b95-bada-4e79-86ac-24a3cf8deb56 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:20.078659 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44a89b95-bada-4e79-86ac-24a3cf8deb56 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:20.079107 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44a89b95-bada-4e79-86ac-24a3cf8deb56 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:20.212274 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-44a89b95-bada-4e79-86ac-24a3cf8deb56 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:20.219876 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-44a89b95-bada-4e79-86ac-24a3cf8deb56 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.152212 Jul 19 09:28:20.220437 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 293/560] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:20 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:20.221852 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5a46ba29-7337-49f6-8368-c2ddee79f056 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:20.222458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5a46ba29-7337-49f6-8368-c2ddee79f056 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:20.228203 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5a46ba29-7337-49f6-8368-c2ddee79f056 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:20.228644 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5a46ba29-7337-49f6-8368-c2ddee79f056 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:20.229442 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5a46ba29-7337-49f6-8368-c2ddee79f056 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:20.229872 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5a46ba29-7337-49f6-8368-c2ddee79f056 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:20.357067 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5a46ba29-7337-49f6-8368-c2ddee79f056 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:20.365174 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5a46ba29-7337-49f6-8368-c2ddee79f056 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:20.366678 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5a46ba29-7337-49f6-8368-c2ddee79f056 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:20.367838 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5a46ba29-7337-49f6-8368-c2ddee79f056 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.150080 Jul 19 09:28:20.368395 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 268/561] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:20 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:28:21.237219 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-14fb8d97-bf54-44ce-bbc5-53b4352598a1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:21.237816 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-14fb8d97-bf54-44ce-bbc5-53b4352598a1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:21.243955 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14fb8d97-bf54-44ce-bbc5-53b4352598a1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:21.244401 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14fb8d97-bf54-44ce-bbc5-53b4352598a1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:21.245158 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14fb8d97-bf54-44ce-bbc5-53b4352598a1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:21.245585 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14fb8d97-bf54-44ce-bbc5-53b4352598a1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:21.373912 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-14fb8d97-bf54-44ce-bbc5-53b4352598a1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:21.381860 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-14fb8d97-bf54-44ce-bbc5-53b4352598a1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.148791 Jul 19 09:28:21.382426 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 294/562] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:21 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:21.385634 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a8f5a8b7-5c15-436c-b54e-7453c3d0f377 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:21.386247 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a8f5a8b7-5c15-436c-b54e-7453c3d0f377 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:21.392059 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a8f5a8b7-5c15-436c-b54e-7453c3d0f377 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:21.392513 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a8f5a8b7-5c15-436c-b54e-7453c3d0f377 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:21.393805 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a8f5a8b7-5c15-436c-b54e-7453c3d0f377 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:21.394237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a8f5a8b7-5c15-436c-b54e-7453c3d0f377 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:21.525149 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a8f5a8b7-5c15-436c-b54e-7453c3d0f377 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:21.533275 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a8f5a8b7-5c15-436c-b54e-7453c3d0f377 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:21.534779 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a8f5a8b7-5c15-436c-b54e-7453c3d0f377 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:21.535929 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a8f5a8b7-5c15-436c-b54e-7453c3d0f377 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.154154 Jul 19 09:28:21.536490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 269/563] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:21 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:28:22.398013 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d6ee9064-82f4-49db-bf67-5ccbdd6cd587 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:22.398601 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d6ee9064-82f4-49db-bf67-5ccbdd6cd587 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:22.404293 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d6ee9064-82f4-49db-bf67-5ccbdd6cd587 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:22.404740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d6ee9064-82f4-49db-bf67-5ccbdd6cd587 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:22.405521 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d6ee9064-82f4-49db-bf67-5ccbdd6cd587 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:22.405948 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d6ee9064-82f4-49db-bf67-5ccbdd6cd587 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:22.537841 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d6ee9064-82f4-49db-bf67-5ccbdd6cd587 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:22.545651 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d6ee9064-82f4-49db-bf67-5ccbdd6cd587 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.151312 Jul 19 09:28:22.546215 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 295/564] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:22 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:22.553938 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5cc1458b-41b1-417f-9c94-7894a4753e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:22.554623 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5cc1458b-41b1-417f-9c94-7894a4753e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:22.560440 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5cc1458b-41b1-417f-9c94-7894a4753e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:22.560888 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5cc1458b-41b1-417f-9c94-7894a4753e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:22.561646 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5cc1458b-41b1-417f-9c94-7894a4753e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:22.562075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5cc1458b-41b1-417f-9c94-7894a4753e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:22.696732 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5cc1458b-41b1-417f-9c94-7894a4753e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:22.705007 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5cc1458b-41b1-417f-9c94-7894a4753e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:22.707105 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5cc1458b-41b1-417f-9c94-7894a4753e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:22.708246 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5cc1458b-41b1-417f-9c94-7894a4753e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.157985 Jul 19 09:28:22.708805 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 270/565] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:22 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:23.562717 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a9fcc2eb-7c53-4331-81c9-7a238348c39c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:23.563530 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a9fcc2eb-7c53-4331-81c9-7a238348c39c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:23.569269 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a9fcc2eb-7c53-4331-81c9-7a238348c39c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:23.569724 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a9fcc2eb-7c53-4331-81c9-7a238348c39c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:23.570492 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a9fcc2eb-7c53-4331-81c9-7a238348c39c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:23.570928 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a9fcc2eb-7c53-4331-81c9-7a238348c39c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:23.702686 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a9fcc2eb-7c53-4331-81c9-7a238348c39c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:23.710800 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a9fcc2eb-7c53-4331-81c9-7a238348c39c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.151743 Jul 19 09:28:23.711402 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 296/566] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:23 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:23.725339 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3cff46b8-398b-4ef8-9d56-bf2520d5cd82 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:23.725940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3cff46b8-398b-4ef8-9d56-bf2520d5cd82 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:23.731658 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3cff46b8-398b-4ef8-9d56-bf2520d5cd82 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:23.732106 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3cff46b8-398b-4ef8-9d56-bf2520d5cd82 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:23.732896 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3cff46b8-398b-4ef8-9d56-bf2520d5cd82 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:23.733328 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3cff46b8-398b-4ef8-9d56-bf2520d5cd82 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:23.861533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3cff46b8-398b-4ef8-9d56-bf2520d5cd82 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:23.870162 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3cff46b8-398b-4ef8-9d56-bf2520d5cd82 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:23.871683 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3cff46b8-398b-4ef8-9d56-bf2520d5cd82 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:23.872799 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3cff46b8-398b-4ef8-9d56-bf2520d5cd82 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.151155 Jul 19 09:28:23.873355 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 271/567] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:23 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:24.727289 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-fab2e44c-3f0a-44a9-8d41-15d05c62d073 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:24.727894 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-fab2e44c-3f0a-44a9-8d41-15d05c62d073 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:24.733889 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fab2e44c-3f0a-44a9-8d41-15d05c62d073 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:24.734333 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fab2e44c-3f0a-44a9-8d41-15d05c62d073 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:24.735138 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fab2e44c-3f0a-44a9-8d41-15d05c62d073 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:24.735568 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fab2e44c-3f0a-44a9-8d41-15d05c62d073 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:24.864180 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-fab2e44c-3f0a-44a9-8d41-15d05c62d073 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:24.871854 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-fab2e44c-3f0a-44a9-8d41-15d05c62d073 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.148227 Jul 19 09:28:24.872415 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 297/568] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:24 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:28:24.890616 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cff33829-159c-498e-97cf-54a2a81aa61d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:24.891266 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cff33829-159c-498e-97cf-54a2a81aa61d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:24.897585 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cff33829-159c-498e-97cf-54a2a81aa61d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:24.898033 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cff33829-159c-498e-97cf-54a2a81aa61d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:24.898790 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cff33829-159c-498e-97cf-54a2a81aa61d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:24.899256 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cff33829-159c-498e-97cf-54a2a81aa61d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:25.032511 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cff33829-159c-498e-97cf-54a2a81aa61d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:25.040600 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cff33829-159c-498e-97cf-54a2a81aa61d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:25.042355 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cff33829-159c-498e-97cf-54a2a81aa61d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:25.043511 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cff33829-159c-498e-97cf-54a2a81aa61d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.156636 Jul 19 09:28:25.044213 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 272/569] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:24 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:25.888759 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a4f7d889-6206-4177-9fd2-d5eb8ef6e54c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:25.889361 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a4f7d889-6206-4177-9fd2-d5eb8ef6e54c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:25.895201 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4f7d889-6206-4177-9fd2-d5eb8ef6e54c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:25.895645 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4f7d889-6206-4177-9fd2-d5eb8ef6e54c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:25.896398 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4f7d889-6206-4177-9fd2-d5eb8ef6e54c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:25.896824 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4f7d889-6206-4177-9fd2-d5eb8ef6e54c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:26.030191 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a4f7d889-6206-4177-9fd2-d5eb8ef6e54c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:26.038306 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a4f7d889-6206-4177-9fd2-d5eb8ef6e54c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.153232 Jul 19 09:28:26.038863 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 298/570] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:25 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:26.061196 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f9001056-2d19-46e8-b67e-2bb101cd56ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:26.061797 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f9001056-2d19-46e8-b67e-2bb101cd56ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:26.068427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f9001056-2d19-46e8-b67e-2bb101cd56ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:26.068864 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f9001056-2d19-46e8-b67e-2bb101cd56ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:26.069610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f9001056-2d19-46e8-b67e-2bb101cd56ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:26.070037 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f9001056-2d19-46e8-b67e-2bb101cd56ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:26.200041 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f9001056-2d19-46e8-b67e-2bb101cd56ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:26.208107 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f9001056-2d19-46e8-b67e-2bb101cd56ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:26.209607 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f9001056-2d19-46e8-b67e-2bb101cd56ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:26.210732 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f9001056-2d19-46e8-b67e-2bb101cd56ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153108 Jul 19 09:28:26.211332 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 273/571] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:26 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:27.055546 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0cb6bfed-9d7d-4fee-893f-0a39e305929e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:27.056157 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0cb6bfed-9d7d-4fee-893f-0a39e305929e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:27.061906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0cb6bfed-9d7d-4fee-893f-0a39e305929e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:27.062356 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0cb6bfed-9d7d-4fee-893f-0a39e305929e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:27.063142 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0cb6bfed-9d7d-4fee-893f-0a39e305929e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:27.063584 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0cb6bfed-9d7d-4fee-893f-0a39e305929e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:27.202303 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0cb6bfed-9d7d-4fee-893f-0a39e305929e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:27.209899 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0cb6bfed-9d7d-4fee-893f-0a39e305929e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.157977 Jul 19 09:28:27.210469 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 299/572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:27 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:27.229630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6ceb9e86-9e82-466c-90e2-7cc34b047526 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:27.230241 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6ceb9e86-9e82-466c-90e2-7cc34b047526 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:27.236132 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ceb9e86-9e82-466c-90e2-7cc34b047526 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:27.237073 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ceb9e86-9e82-466c-90e2-7cc34b047526 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:27.237833 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ceb9e86-9e82-466c-90e2-7cc34b047526 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:27.238268 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ceb9e86-9e82-466c-90e2-7cc34b047526 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:27.377822 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6ceb9e86-9e82-466c-90e2-7cc34b047526 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:27.385858 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6ceb9e86-9e82-466c-90e2-7cc34b047526 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:27.387388 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6ceb9e86-9e82-466c-90e2-7cc34b047526 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:27.388511 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6ceb9e86-9e82-466c-90e2-7cc34b047526 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.162872 Jul 19 09:28:27.389065 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 274/573] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:27 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:28:28.226469 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f450ff1c-309e-434e-9d24-a0ac170c1f5e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:28.227113 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f450ff1c-309e-434e-9d24-a0ac170c1f5e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:28.232838 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f450ff1c-309e-434e-9d24-a0ac170c1f5e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:28.233295 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f450ff1c-309e-434e-9d24-a0ac170c1f5e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:28.234065 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f450ff1c-309e-434e-9d24-a0ac170c1f5e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:28.234502 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f450ff1c-309e-434e-9d24-a0ac170c1f5e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:28.369517 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f450ff1c-309e-434e-9d24-a0ac170c1f5e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:28.378244 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f450ff1c-309e-434e-9d24-a0ac170c1f5e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.155371 Jul 19 09:28:28.378789 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 300/574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:28 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:28.405264 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-79335cb8-8f79-4291-80ca-249c61f353c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:28.405887 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-79335cb8-8f79-4291-80ca-249c61f353c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:28.411667 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79335cb8-8f79-4291-80ca-249c61f353c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:28.412110 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79335cb8-8f79-4291-80ca-249c61f353c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:28.412878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79335cb8-8f79-4291-80ca-249c61f353c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:28.413308 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79335cb8-8f79-4291-80ca-249c61f353c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:28.545599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-79335cb8-8f79-4291-80ca-249c61f353c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:28.553608 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-79335cb8-8f79-4291-80ca-249c61f353c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:28.555125 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-79335cb8-8f79-4291-80ca-249c61f353c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:28.556249 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-79335cb8-8f79-4291-80ca-249c61f353c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.154648 Jul 19 09:28:28.556806 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 275/575] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:28 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:29.395268 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-16e99d07-ca4a-43d5-baa2-16e0e0dbf135 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:29.395870 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-16e99d07-ca4a-43d5-baa2-16e0e0dbf135 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:29.402271 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16e99d07-ca4a-43d5-baa2-16e0e0dbf135 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:29.402720 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16e99d07-ca4a-43d5-baa2-16e0e0dbf135 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:29.403509 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16e99d07-ca4a-43d5-baa2-16e0e0dbf135 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:29.403936 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16e99d07-ca4a-43d5-baa2-16e0e0dbf135 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:29.533994 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-16e99d07-ca4a-43d5-baa2-16e0e0dbf135 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:29.542177 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-16e99d07-ca4a-43d5-baa2-16e0e0dbf135 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.150603 Jul 19 09:28:29.542735 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 301/576] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:29 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:29.575100 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c83175e9-d6c2-4416-87eb-e815b47f5329 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:29.575714 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c83175e9-d6c2-4416-87eb-e815b47f5329 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:29.581469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c83175e9-d6c2-4416-87eb-e815b47f5329 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:29.581922 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c83175e9-d6c2-4416-87eb-e815b47f5329 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:29.582687 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c83175e9-d6c2-4416-87eb-e815b47f5329 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:29.583158 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c83175e9-d6c2-4416-87eb-e815b47f5329 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:29.710287 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c83175e9-d6c2-4416-87eb-e815b47f5329 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:29.718356 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c83175e9-d6c2-4416-87eb-e815b47f5329 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:29.719909 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c83175e9-d6c2-4416-87eb-e815b47f5329 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:29.721048 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c83175e9-d6c2-4416-87eb-e815b47f5329 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.149684 Jul 19 09:28:29.721605 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 276/577] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:29 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:30.559288 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-850eee5f-3b7d-4188-8930-70fae0f87631 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:30.559961 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-850eee5f-3b7d-4188-8930-70fae0f87631 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:30.566481 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-850eee5f-3b7d-4188-8930-70fae0f87631 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:30.566936 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-850eee5f-3b7d-4188-8930-70fae0f87631 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:30.567730 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-850eee5f-3b7d-4188-8930-70fae0f87631 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:30.568171 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-850eee5f-3b7d-4188-8930-70fae0f87631 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:30.699898 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-850eee5f-3b7d-4188-8930-70fae0f87631 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:30.707663 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-850eee5f-3b7d-4188-8930-70fae0f87631 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.152014 Jul 19 09:28:30.708301 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 302/578] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:30 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:30.739432 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c5598033-a22e-4916-8ffd-773ee39c07b4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:30.740046 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c5598033-a22e-4916-8ffd-773ee39c07b4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:30.745837 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c5598033-a22e-4916-8ffd-773ee39c07b4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:30.746292 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c5598033-a22e-4916-8ffd-773ee39c07b4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:30.747082 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c5598033-a22e-4916-8ffd-773ee39c07b4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:30.747522 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c5598033-a22e-4916-8ffd-773ee39c07b4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:30.948770 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c5598033-a22e-4916-8ffd-773ee39c07b4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:30.957520 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c5598033-a22e-4916-8ffd-773ee39c07b4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:30.959028 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c5598033-a22e-4916-8ffd-773ee39c07b4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:30.960189 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c5598033-a22e-4916-8ffd-773ee39c07b4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.225031 Jul 19 09:28:30.960754 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 277/579] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:30 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:28:31.727591 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-53a0e162-1599-48ce-9a45-d80d13a6c457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:31.729365 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-53a0e162-1599-48ce-9a45-d80d13a6c457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:31.734985 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-53a0e162-1599-48ce-9a45-d80d13a6c457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:31.735534 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-53a0e162-1599-48ce-9a45-d80d13a6c457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:31.736788 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-53a0e162-1599-48ce-9a45-d80d13a6c457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:31.737220 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-53a0e162-1599-48ce-9a45-d80d13a6c457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:31.871921 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-53a0e162-1599-48ce-9a45-d80d13a6c457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:31.880398 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-53a0e162-1599-48ce-9a45-d80d13a6c457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1549 microversion: 2.1 time: 0.158168 Jul 19 09:28:31.880953 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 303/580] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:31 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:31.896316 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-020bfd7b-8633-4261-9932-df95eb00e2d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:31.896812 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-020bfd7b-8633-4261-9932-df95eb00e2d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:31.902458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-020bfd7b-8633-4261-9932-df95eb00e2d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:31.902911 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-020bfd7b-8633-4261-9932-df95eb00e2d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:31.903721 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-020bfd7b-8633-4261-9932-df95eb00e2d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:31.904254 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-020bfd7b-8633-4261-9932-df95eb00e2d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:31.977490 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-38d2f086-7209-4a82-8100-b7c609085ced tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:31.978104 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-38d2f086-7209-4a82-8100-b7c609085ced tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:31.984123 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-38d2f086-7209-4a82-8100-b7c609085ced tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:31.984641 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-38d2f086-7209-4a82-8100-b7c609085ced tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:31.985510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-38d2f086-7209-4a82-8100-b7c609085ced tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:31.985952 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-38d2f086-7209-4a82-8100-b7c609085ced tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:31.990115 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-020bfd7b-8633-4261-9932-df95eb00e2d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] HTTP exception thrown: Cannot 'detach_volume' instance 0ee4430d-0d5f-45bd-848e-aa6f05870b67 while it is in vm_state rescued Jul 19 09:28:31.990930 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-020bfd7b-8633-4261-9932-df95eb00e2d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Returning 409 to user: Cannot 'detach_volume' instance 0ee4430d-0d5f-45bd-848e-aa6f05870b67 while it is in vm_state rescued {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:28:31.992062 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-020bfd7b-8633-4261-9932-df95eb00e2d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/os-volume_attachments/926a9a41-9cb7-411f-b76d-664eec21d671" status: 409 len: 152 microversion: 2.1 time: 0.099533 Jul 19 09:28:31.992608 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 278/581] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Jul 19 09:28:31 2021] DELETE /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/os-volume_attachments/926a9a41-9cb7-411f-b76d-664eec21d671 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 09:28:32.000618 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1a87b6f6-9135-421b-8669-67927a643914 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:28:32.001141 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1a87b6f6-9135-421b-8669-67927a643914 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:32.007495 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1a87b6f6-9135-421b-8669-67927a643914 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:32.007941 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1a87b6f6-9135-421b-8669-67927a643914 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:32.008702 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1a87b6f6-9135-421b-8669-67927a643914 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:32.009132 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1a87b6f6-9135-421b-8669-67927a643914 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:32.076040 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1a87b6f6-9135-421b-8669-67927a643914 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "POST /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/action" status: 202 len: 0 microversion: 2.1 time: 0.078808 Jul 19 09:28:32.079611 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 279/582] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:28:31 2021] POST /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:28:32.084988 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f9aef54f-0c07-42e5-b629-7643e2166a15 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:32.085601 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f9aef54f-0c07-42e5-b629-7643e2166a15 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:32.091641 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f9aef54f-0c07-42e5-b629-7643e2166a15 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:32.092100 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f9aef54f-0c07-42e5-b629-7643e2166a15 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:32.092876 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f9aef54f-0c07-42e5-b629-7643e2166a15 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:32.093319 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f9aef54f-0c07-42e5-b629-7643e2166a15 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:32.128292 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-38d2f086-7209-4a82-8100-b7c609085ced tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:32.136680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-38d2f086-7209-4a82-8100-b7c609085ced tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:32.138192 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-38d2f086-7209-4a82-8100-b7c609085ced tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:32.139361 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-38d2f086-7209-4a82-8100-b7c609085ced tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.165582 Jul 19 09:28:32.145572 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 304/583] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:31 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:28:32.326909 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f9aef54f-0c07-42e5-b629-7643e2166a15 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:32.334953 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f9aef54f-0c07-42e5-b629-7643e2166a15 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1557 microversion: 2.1 time: 0.253897 Jul 19 09:28:32.335554 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 280/584] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:32 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1557 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:33.157629 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-37511e1a-9911-4cba-b191-b58b13740abc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:33.158244 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-37511e1a-9911-4cba-b191-b58b13740abc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:33.164312 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37511e1a-9911-4cba-b191-b58b13740abc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:33.164755 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37511e1a-9911-4cba-b191-b58b13740abc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:33.165503 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37511e1a-9911-4cba-b191-b58b13740abc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:33.165933 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37511e1a-9911-4cba-b191-b58b13740abc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:33.300130 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-37511e1a-9911-4cba-b191-b58b13740abc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:33.309557 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-37511e1a-9911-4cba-b191-b58b13740abc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:33.312286 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-37511e1a-9911-4cba-b191-b58b13740abc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:33.313424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-37511e1a-9911-4cba-b191-b58b13740abc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.159745 Jul 19 09:28:33.313974 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 305/585] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:33 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:33.351811 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-59465dcc-b9aa-4705-b3bc-50bc8e3a6b58 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:33.352418 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-59465dcc-b9aa-4705-b3bc-50bc8e3a6b58 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:33.358240 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-59465dcc-b9aa-4705-b3bc-50bc8e3a6b58 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:33.358687 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-59465dcc-b9aa-4705-b3bc-50bc8e3a6b58 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:33.359481 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-59465dcc-b9aa-4705-b3bc-50bc8e3a6b58 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:33.359920 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-59465dcc-b9aa-4705-b3bc-50bc8e3a6b58 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:33.493784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-59465dcc-b9aa-4705-b3bc-50bc8e3a6b58 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:33.501428 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-59465dcc-b9aa-4705-b3bc-50bc8e3a6b58 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1557 microversion: 2.1 time: 0.153305 Jul 19 09:28:33.502525 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 281/586] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:33 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:34.333396 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f6ade17f-bf5a-4e46-81bf-ce18ebe1f378 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:34.333813 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f6ade17f-bf5a-4e46-81bf-ce18ebe1f378 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:34.339304 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6ade17f-bf5a-4e46-81bf-ce18ebe1f378 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:34.339756 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6ade17f-bf5a-4e46-81bf-ce18ebe1f378 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:34.340517 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6ade17f-bf5a-4e46-81bf-ce18ebe1f378 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:34.340951 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6ade17f-bf5a-4e46-81bf-ce18ebe1f378 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:34.469331 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f6ade17f-bf5a-4e46-81bf-ce18ebe1f378 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:34.477961 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f6ade17f-bf5a-4e46-81bf-ce18ebe1f378 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:34.479472 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f6ade17f-bf5a-4e46-81bf-ce18ebe1f378 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:34.480597 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f6ade17f-bf5a-4e46-81bf-ce18ebe1f378 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152143 Jul 19 09:28:34.481149 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 306/587] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:34 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:34.519075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-82f74872-efd7-4c06-9aa2-0fa8361a2fdf tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:34.519679 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-82f74872-efd7-4c06-9aa2-0fa8361a2fdf tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:34.525340 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-82f74872-efd7-4c06-9aa2-0fa8361a2fdf tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:34.525777 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-82f74872-efd7-4c06-9aa2-0fa8361a2fdf tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:34.526528 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-82f74872-efd7-4c06-9aa2-0fa8361a2fdf tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:34.526952 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-82f74872-efd7-4c06-9aa2-0fa8361a2fdf tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:34.661184 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-82f74872-efd7-4c06-9aa2-0fa8361a2fdf tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:34.669094 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-82f74872-efd7-4c06-9aa2-0fa8361a2fdf tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1557 microversion: 2.1 time: 0.154133 Jul 19 09:28:34.669656 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 282/588] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:34 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:35.498928 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ab094443-0e56-460f-871e-59dd3606b1b5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:35.499523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ab094443-0e56-460f-871e-59dd3606b1b5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:35.505944 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ab094443-0e56-460f-871e-59dd3606b1b5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:35.506386 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ab094443-0e56-460f-871e-59dd3606b1b5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:35.507183 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ab094443-0e56-460f-871e-59dd3606b1b5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:35.507619 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ab094443-0e56-460f-871e-59dd3606b1b5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:35.635470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ab094443-0e56-460f-871e-59dd3606b1b5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:35.644317 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ab094443-0e56-460f-871e-59dd3606b1b5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:35.645810 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ab094443-0e56-460f-871e-59dd3606b1b5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:35.646930 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ab094443-0e56-460f-871e-59dd3606b1b5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.151777 Jul 19 09:28:35.647497 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 307/589] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:35 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:35.685201 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f776d9f4-f00f-40eb-b6b2-278b0cbe94f0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:35.685805 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f776d9f4-f00f-40eb-b6b2-278b0cbe94f0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:35.692402 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f776d9f4-f00f-40eb-b6b2-278b0cbe94f0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:35.692844 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f776d9f4-f00f-40eb-b6b2-278b0cbe94f0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:35.693596 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f776d9f4-f00f-40eb-b6b2-278b0cbe94f0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:35.694023 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f776d9f4-f00f-40eb-b6b2-278b0cbe94f0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:35.822997 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f776d9f4-f00f-40eb-b6b2-278b0cbe94f0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:35.830649 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f776d9f4-f00f-40eb-b6b2-278b0cbe94f0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1563 microversion: 2.1 time: 0.148999 Jul 19 09:28:35.831227 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 283/590] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:28:35 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:28:35.899910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-06f4283c-9e48-487d-9e47-7b2d8bac19e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:35.900400 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-06f4283c-9e48-487d-9e47-7b2d8bac19e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:35.906141 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-06f4283c-9e48-487d-9e47-7b2d8bac19e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:35.906668 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-06f4283c-9e48-487d-9e47-7b2d8bac19e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:35.907831 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-06f4283c-9e48-487d-9e47-7b2d8bac19e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:35.908937 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-06f4283c-9e48-487d-9e47-7b2d8bac19e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:35.993979 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.objects.instance [None req-06f4283c-9e48-487d-9e47-7b2d8bac19e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lazy-loading 'services' on Instance uuid 0ee4430d-0d5f-45bd-848e-aa6f05870b67 {{(pid=107463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:28:36.062707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-06f4283c-9e48-487d-9e47-7b2d8bac19e0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/os-volume_attachments/926a9a41-9cb7-411f-b76d-664eec21d671" status: 202 len: 0 microversion: 2.1 time: 0.166261 Jul 19 09:28:36.063376 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 308/591] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Jul 19 09:28:35 2021] DELETE /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67/os-volume_attachments/926a9a41-9cb7-411f-b76d-664eec21d671 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:28:36.664567 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b4f03b74-97c2-4190-89cb-3eac6a94503a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:36.665162 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b4f03b74-97c2-4190-89cb-3eac6a94503a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:36.670973 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b4f03b74-97c2-4190-89cb-3eac6a94503a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:36.671449 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b4f03b74-97c2-4190-89cb-3eac6a94503a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:36.672210 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b4f03b74-97c2-4190-89cb-3eac6a94503a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:36.672636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b4f03b74-97c2-4190-89cb-3eac6a94503a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:36.806917 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b4f03b74-97c2-4190-89cb-3eac6a94503a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:36.815695 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b4f03b74-97c2-4190-89cb-3eac6a94503a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:36.817431 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b4f03b74-97c2-4190-89cb-3eac6a94503a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:36.818881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b4f03b74-97c2-4190-89cb-3eac6a94503a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.157909 Jul 19 09:28:36.819510 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 284/592] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:36 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:37.838637 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2f79bb18-fc0b-4c1f-b9cb-4ec5f1649f8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:37.839358 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2f79bb18-fc0b-4c1f-b9cb-4ec5f1649f8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:37.845452 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f79bb18-fc0b-4c1f-b9cb-4ec5f1649f8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:37.845904 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f79bb18-fc0b-4c1f-b9cb-4ec5f1649f8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:37.846668 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f79bb18-fc0b-4c1f-b9cb-4ec5f1649f8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:37.847139 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f79bb18-fc0b-4c1f-b9cb-4ec5f1649f8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:37.980435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2f79bb18-fc0b-4c1f-b9cb-4ec5f1649f8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:37.989168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2f79bb18-fc0b-4c1f-b9cb-4ec5f1649f8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:37.990679 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2f79bb18-fc0b-4c1f-b9cb-4ec5f1649f8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:37.991862 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2f79bb18-fc0b-4c1f-b9cb-4ec5f1649f8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.157266 Jul 19 09:28:37.992418 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 309/593] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:37 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:39.010257 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-44a39bdd-67ec-470c-895b-ccacaed37835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:39.010843 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-44a39bdd-67ec-470c-895b-ccacaed37835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:39.016793 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44a39bdd-67ec-470c-895b-ccacaed37835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:39.017178 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44a39bdd-67ec-470c-895b-ccacaed37835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:39.018501 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44a39bdd-67ec-470c-895b-ccacaed37835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:39.018930 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44a39bdd-67ec-470c-895b-ccacaed37835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:39.149566 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-44a39bdd-67ec-470c-895b-ccacaed37835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:39.157630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-44a39bdd-67ec-470c-895b-ccacaed37835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:39.159169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-44a39bdd-67ec-470c-895b-ccacaed37835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:39.160293 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-44a39bdd-67ec-470c-895b-ccacaed37835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153703 Jul 19 09:28:39.160854 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 285/594] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:39 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:28:40.178811 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-25942240-c6b0-4cf7-a74d-54b9b792e7c2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:40.179458 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-25942240-c6b0-4cf7-a74d-54b9b792e7c2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:40.185337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-25942240-c6b0-4cf7-a74d-54b9b792e7c2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:40.185787 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-25942240-c6b0-4cf7-a74d-54b9b792e7c2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:40.186549 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-25942240-c6b0-4cf7-a74d-54b9b792e7c2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:40.186982 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-25942240-c6b0-4cf7-a74d-54b9b792e7c2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:40.318146 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-25942240-c6b0-4cf7-a74d-54b9b792e7c2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:40.326202 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-25942240-c6b0-4cf7-a74d-54b9b792e7c2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:40.327731 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-25942240-c6b0-4cf7-a74d-54b9b792e7c2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:40.328898 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-25942240-c6b0-4cf7-a74d-54b9b792e7c2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153859 Jul 19 09:28:40.329698 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 310/595] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:40 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:41.348123 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-dba03b8b-d6be-4493-a85d-3a092b5d4235 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:41.348730 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-dba03b8b-d6be-4493-a85d-3a092b5d4235 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:41.354507 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dba03b8b-d6be-4493-a85d-3a092b5d4235 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:41.354956 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dba03b8b-d6be-4493-a85d-3a092b5d4235 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:41.355750 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dba03b8b-d6be-4493-a85d-3a092b5d4235 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:41.356188 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dba03b8b-d6be-4493-a85d-3a092b5d4235 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:41.488147 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-dba03b8b-d6be-4493-a85d-3a092b5d4235 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:41.496224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-dba03b8b-d6be-4493-a85d-3a092b5d4235 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:41.497725 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-dba03b8b-d6be-4493-a85d-3a092b5d4235 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:41.498852 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-dba03b8b-d6be-4493-a85d-3a092b5d4235 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.154402 Jul 19 09:28:41.499430 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 286/596] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:41 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:42.516621 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0a5bd338-d2e0-4cb9-89ad-75da2c3b91c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:42.517242 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0a5bd338-d2e0-4cb9-89ad-75da2c3b91c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:42.523143 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a5bd338-d2e0-4cb9-89ad-75da2c3b91c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:42.523605 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a5bd338-d2e0-4cb9-89ad-75da2c3b91c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:42.524372 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a5bd338-d2e0-4cb9-89ad-75da2c3b91c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:42.524805 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a5bd338-d2e0-4cb9-89ad-75da2c3b91c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:42.655332 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0a5bd338-d2e0-4cb9-89ad-75da2c3b91c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:42.663902 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0a5bd338-d2e0-4cb9-89ad-75da2c3b91c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:42.665408 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0a5bd338-d2e0-4cb9-89ad-75da2c3b91c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:42.666833 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0a5bd338-d2e0-4cb9-89ad-75da2c3b91c4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153625 Jul 19 09:28:42.667437 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 311/597] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:42 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:43.685208 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0b4e9a07-3981-4a1e-a5ce-9525a8af3d95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:43.685813 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0b4e9a07-3981-4a1e-a5ce-9525a8af3d95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:43.692565 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0b4e9a07-3981-4a1e-a5ce-9525a8af3d95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:43.692992 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0b4e9a07-3981-4a1e-a5ce-9525a8af3d95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:43.693752 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0b4e9a07-3981-4a1e-a5ce-9525a8af3d95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:43.694185 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0b4e9a07-3981-4a1e-a5ce-9525a8af3d95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:43.827310 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0b4e9a07-3981-4a1e-a5ce-9525a8af3d95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:43.835403 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0b4e9a07-3981-4a1e-a5ce-9525a8af3d95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:43.836903 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0b4e9a07-3981-4a1e-a5ce-9525a8af3d95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:43.838032 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0b4e9a07-3981-4a1e-a5ce-9525a8af3d95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.156507 Jul 19 09:28:43.838585 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 287/598] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:43 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:44.855616 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9054ee5a-b48c-446c-84c1-1f6bb4e34880 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:44.856140 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9054ee5a-b48c-446c-84c1-1f6bb4e34880 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:44.862375 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9054ee5a-b48c-446c-84c1-1f6bb4e34880 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:44.862821 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9054ee5a-b48c-446c-84c1-1f6bb4e34880 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:44.863600 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9054ee5a-b48c-446c-84c1-1f6bb4e34880 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:44.864035 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9054ee5a-b48c-446c-84c1-1f6bb4e34880 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:44.994030 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9054ee5a-b48c-446c-84c1-1f6bb4e34880 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:45.002079 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9054ee5a-b48c-446c-84c1-1f6bb4e34880 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:45.003613 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9054ee5a-b48c-446c-84c1-1f6bb4e34880 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:45.004738 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9054ee5a-b48c-446c-84c1-1f6bb4e34880 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152887 Jul 19 09:28:45.005285 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 312/599] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:44 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:46.023313 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-23ccc262-3005-4f7a-9fa2-8db1d1ad2b06 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:46.023917 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-23ccc262-3005-4f7a-9fa2-8db1d1ad2b06 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:46.030045 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-23ccc262-3005-4f7a-9fa2-8db1d1ad2b06 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:46.030487 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-23ccc262-3005-4f7a-9fa2-8db1d1ad2b06 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:46.031287 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-23ccc262-3005-4f7a-9fa2-8db1d1ad2b06 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:46.031716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-23ccc262-3005-4f7a-9fa2-8db1d1ad2b06 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:46.170764 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-23ccc262-3005-4f7a-9fa2-8db1d1ad2b06 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:46.178832 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-23ccc262-3005-4f7a-9fa2-8db1d1ad2b06 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:46.180360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-23ccc262-3005-4f7a-9fa2-8db1d1ad2b06 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:46.181493 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-23ccc262-3005-4f7a-9fa2-8db1d1ad2b06 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.161932 Jul 19 09:28:46.182372 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 288/600] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:46 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:47.200058 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3c70bbb3-ea4e-4d79-8235-16f9c54cd5a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:47.200658 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3c70bbb3-ea4e-4d79-8235-16f9c54cd5a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:47.207630 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3c70bbb3-ea4e-4d79-8235-16f9c54cd5a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:47.208077 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3c70bbb3-ea4e-4d79-8235-16f9c54cd5a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:47.208839 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3c70bbb3-ea4e-4d79-8235-16f9c54cd5a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:47.209274 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3c70bbb3-ea4e-4d79-8235-16f9c54cd5a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:47.337951 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3c70bbb3-ea4e-4d79-8235-16f9c54cd5a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:47.346733 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3c70bbb3-ea4e-4d79-8235-16f9c54cd5a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:47.348255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3c70bbb3-ea4e-4d79-8235-16f9c54cd5a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:47.349379 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3c70bbb3-ea4e-4d79-8235-16f9c54cd5a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153085 Jul 19 09:28:47.349929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 313/601] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:47 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:48.367321 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3bd7417c-8856-4787-b9f8-8db910e62b9a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:48.367928 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3bd7417c-8856-4787-b9f8-8db910e62b9a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:48.373720 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3bd7417c-8856-4787-b9f8-8db910e62b9a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:48.374170 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3bd7417c-8856-4787-b9f8-8db910e62b9a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:48.374933 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3bd7417c-8856-4787-b9f8-8db910e62b9a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:48.375398 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3bd7417c-8856-4787-b9f8-8db910e62b9a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:48.510502 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3bd7417c-8856-4787-b9f8-8db910e62b9a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:48.518654 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3bd7417c-8856-4787-b9f8-8db910e62b9a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:48.520123 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3bd7417c-8856-4787-b9f8-8db910e62b9a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:48.521259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3bd7417c-8856-4787-b9f8-8db910e62b9a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.157659 Jul 19 09:28:48.521815 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 289/602] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:48 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:49.539247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6931113f-2cf3-4c0f-8524-8941797caa1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:49.539811 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6931113f-2cf3-4c0f-8524-8941797caa1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:49.545839 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6931113f-2cf3-4c0f-8524-8941797caa1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:49.546292 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6931113f-2cf3-4c0f-8524-8941797caa1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:49.547073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6931113f-2cf3-4c0f-8524-8941797caa1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:49.547515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6931113f-2cf3-4c0f-8524-8941797caa1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:49.680704 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6931113f-2cf3-4c0f-8524-8941797caa1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:49.689296 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6931113f-2cf3-4c0f-8524-8941797caa1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:49.690809 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6931113f-2cf3-4c0f-8524-8941797caa1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:49.691977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6931113f-2cf3-4c0f-8524-8941797caa1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.156482 Jul 19 09:28:49.692538 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 314/603] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:49 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:50.709421 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1363cff9-dcbc-430f-acb2-362082e7ac58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:50.710052 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1363cff9-dcbc-430f-acb2-362082e7ac58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:50.715939 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1363cff9-dcbc-430f-acb2-362082e7ac58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:50.716388 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1363cff9-dcbc-430f-acb2-362082e7ac58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:50.717182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1363cff9-dcbc-430f-acb2-362082e7ac58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:50.717639 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1363cff9-dcbc-430f-acb2-362082e7ac58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:50.848361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1363cff9-dcbc-430f-acb2-362082e7ac58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:50.856634 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1363cff9-dcbc-430f-acb2-362082e7ac58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:50.858135 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1363cff9-dcbc-430f-acb2-362082e7ac58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:50.859305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1363cff9-dcbc-430f-acb2-362082e7ac58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153502 Jul 19 09:28:50.859874 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 290/604] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:50 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:51.878774 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c4f35eac-7913-44ad-a3fe-aa9c9560fae9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:51.879430 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c4f35eac-7913-44ad-a3fe-aa9c9560fae9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:51.885845 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c4f35eac-7913-44ad-a3fe-aa9c9560fae9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:51.886407 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c4f35eac-7913-44ad-a3fe-aa9c9560fae9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:51.887230 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c4f35eac-7913-44ad-a3fe-aa9c9560fae9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:51.887704 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c4f35eac-7913-44ad-a3fe-aa9c9560fae9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:52.023137 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c4f35eac-7913-44ad-a3fe-aa9c9560fae9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:52.031267 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c4f35eac-7913-44ad-a3fe-aa9c9560fae9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:52.032763 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c4f35eac-7913-44ad-a3fe-aa9c9560fae9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:52.033888 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c4f35eac-7913-44ad-a3fe-aa9c9560fae9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.159811 Jul 19 09:28:52.034643 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 315/605] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:51 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:28:53.052243 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d64894e4-dc2a-4e8a-80b1-017e7def8955 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:53.052868 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d64894e4-dc2a-4e8a-80b1-017e7def8955 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:53.058878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d64894e4-dc2a-4e8a-80b1-017e7def8955 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:53.059356 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d64894e4-dc2a-4e8a-80b1-017e7def8955 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:53.060127 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d64894e4-dc2a-4e8a-80b1-017e7def8955 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:53.060561 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d64894e4-dc2a-4e8a-80b1-017e7def8955 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:53.192299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d64894e4-dc2a-4e8a-80b1-017e7def8955 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:53.200479 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d64894e4-dc2a-4e8a-80b1-017e7def8955 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:53.201987 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d64894e4-dc2a-4e8a-80b1-017e7def8955 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:53.203152 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d64894e4-dc2a-4e8a-80b1-017e7def8955 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.154759 Jul 19 09:28:53.203708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 291/606] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:53 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:54.167137 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:28:54.167137 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:28:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:28:54.221173 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5e176d03-8597-4ad0-99bd-70d4f0a84b18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:54.221772 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5e176d03-8597-4ad0-99bd-70d4f0a84b18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:54.227520 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5e176d03-8597-4ad0-99bd-70d4f0a84b18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:54.227971 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5e176d03-8597-4ad0-99bd-70d4f0a84b18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:54.228722 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5e176d03-8597-4ad0-99bd-70d4f0a84b18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:54.229148 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5e176d03-8597-4ad0-99bd-70d4f0a84b18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:54.362264 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5e176d03-8597-4ad0-99bd-70d4f0a84b18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:54.370523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5e176d03-8597-4ad0-99bd-70d4f0a84b18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:54.372050 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5e176d03-8597-4ad0-99bd-70d4f0a84b18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:54.373169 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5e176d03-8597-4ad0-99bd-70d4f0a84b18 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155771 Jul 19 09:28:54.373753 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 316/607] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:54 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:55.392305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8a65da45-3838-4f41-a1ba-01e0f8e6ee33 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:55.392845 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8a65da45-3838-4f41-a1ba-01e0f8e6ee33 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:55.398723 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8a65da45-3838-4f41-a1ba-01e0f8e6ee33 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:55.399199 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8a65da45-3838-4f41-a1ba-01e0f8e6ee33 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:55.399961 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8a65da45-3838-4f41-a1ba-01e0f8e6ee33 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:55.400393 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8a65da45-3838-4f41-a1ba-01e0f8e6ee33 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:55.535202 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8a65da45-3838-4f41-a1ba-01e0f8e6ee33 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:55.543573 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8a65da45-3838-4f41-a1ba-01e0f8e6ee33 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:55.545131 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8a65da45-3838-4f41-a1ba-01e0f8e6ee33 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:55.546289 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8a65da45-3838-4f41-a1ba-01e0f8e6ee33 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.157969 Jul 19 09:28:55.546827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 292/608] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:55 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:56.565137 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e9230707-2985-4505-a707-62f92a36bcf5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:56.565731 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e9230707-2985-4505-a707-62f92a36bcf5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:56.571467 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9230707-2985-4505-a707-62f92a36bcf5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:56.571913 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9230707-2985-4505-a707-62f92a36bcf5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:56.572664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9230707-2985-4505-a707-62f92a36bcf5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:56.573090 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9230707-2985-4505-a707-62f92a36bcf5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:56.701626 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e9230707-2985-4505-a707-62f92a36bcf5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:56.710208 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e9230707-2985-4505-a707-62f92a36bcf5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:56.711741 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e9230707-2985-4505-a707-62f92a36bcf5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:56.712874 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e9230707-2985-4505-a707-62f92a36bcf5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152016 Jul 19 09:28:56.713438 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 317/609] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:56 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:57.731547 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1999df61-d673-41dc-94e6-9183a57f0de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:57.732136 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1999df61-d673-41dc-94e6-9183a57f0de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:57.738548 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1999df61-d673-41dc-94e6-9183a57f0de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:57.738993 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1999df61-d673-41dc-94e6-9183a57f0de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:57.739769 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1999df61-d673-41dc-94e6-9183a57f0de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:57.740196 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1999df61-d673-41dc-94e6-9183a57f0de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:57.872513 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1999df61-d673-41dc-94e6-9183a57f0de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:57.881304 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1999df61-d673-41dc-94e6-9183a57f0de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:57.882861 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1999df61-d673-41dc-94e6-9183a57f0de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:57.884014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1999df61-d673-41dc-94e6-9183a57f0de9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.156195 Jul 19 09:28:57.884552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 293/610] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:57 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:28:58.902504 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1b42054d-5d6c-4aba-a312-ee299f8cde9d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:28:58.903247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1b42054d-5d6c-4aba-a312-ee299f8cde9d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:28:58.909008 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b42054d-5d6c-4aba-a312-ee299f8cde9d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:58.909520 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b42054d-5d6c-4aba-a312-ee299f8cde9d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:58.910386 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b42054d-5d6c-4aba-a312-ee299f8cde9d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:28:58.910853 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b42054d-5d6c-4aba-a312-ee299f8cde9d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:28:59.039589 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1b42054d-5d6c-4aba-a312-ee299f8cde9d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:59.047958 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1b42054d-5d6c-4aba-a312-ee299f8cde9d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:59.049457 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1b42054d-5d6c-4aba-a312-ee299f8cde9d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:28:59.050587 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1b42054d-5d6c-4aba-a312-ee299f8cde9d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.151725 Jul 19 09:28:59.051169 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 318/611] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:28:58 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:00.068584 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3a7bc6b1-bd6f-4309-99a5-95f00e41fbbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:00.069480 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3a7bc6b1-bd6f-4309-99a5-95f00e41fbbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:00.075078 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3a7bc6b1-bd6f-4309-99a5-95f00e41fbbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:00.075533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3a7bc6b1-bd6f-4309-99a5-95f00e41fbbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:00.076293 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3a7bc6b1-bd6f-4309-99a5-95f00e41fbbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:00.076729 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3a7bc6b1-bd6f-4309-99a5-95f00e41fbbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:00.210974 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3a7bc6b1-bd6f-4309-99a5-95f00e41fbbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:00.219129 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3a7bc6b1-bd6f-4309-99a5-95f00e41fbbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:00.221182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3a7bc6b1-bd6f-4309-99a5-95f00e41fbbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:00.222314 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3a7bc6b1-bd6f-4309-99a5-95f00e41fbbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.157470 Jul 19 09:29:00.222865 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 294/612] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:00 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:01.240248 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-73300fad-1eb5-45cc-b9be-e2fbb9d80ea0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:01.240916 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-73300fad-1eb5-45cc-b9be-e2fbb9d80ea0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:01.246767 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-73300fad-1eb5-45cc-b9be-e2fbb9d80ea0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:01.247261 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-73300fad-1eb5-45cc-b9be-e2fbb9d80ea0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:01.248026 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-73300fad-1eb5-45cc-b9be-e2fbb9d80ea0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:01.248459 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-73300fad-1eb5-45cc-b9be-e2fbb9d80ea0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:01.380744 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-73300fad-1eb5-45cc-b9be-e2fbb9d80ea0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:01.389236 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-73300fad-1eb5-45cc-b9be-e2fbb9d80ea0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:01.390731 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-73300fad-1eb5-45cc-b9be-e2fbb9d80ea0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:01.392510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-73300fad-1eb5-45cc-b9be-e2fbb9d80ea0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.156029 Jul 19 09:29:01.393054 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 319/613] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:01 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:02.410582 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a4a782e0-4c13-4d8b-a35e-6e8e0db61c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:02.411267 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a4a782e0-4c13-4d8b-a35e-6e8e0db61c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:02.417254 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4a782e0-4c13-4d8b-a35e-6e8e0db61c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:02.417697 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4a782e0-4c13-4d8b-a35e-6e8e0db61c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:02.418449 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4a782e0-4c13-4d8b-a35e-6e8e0db61c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:02.418880 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4a782e0-4c13-4d8b-a35e-6e8e0db61c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:02.550034 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a4a782e0-4c13-4d8b-a35e-6e8e0db61c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:02.558091 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a4a782e0-4c13-4d8b-a35e-6e8e0db61c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:02.559621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a4a782e0-4c13-4d8b-a35e-6e8e0db61c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:02.560744 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a4a782e0-4c13-4d8b-a35e-6e8e0db61c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.154084 Jul 19 09:29:02.561291 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 295/614] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:02 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:29:03.059716 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b40bc64b-c3b1-4fcb-ae56-dd12c3107555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:03.060164 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b40bc64b-c3b1-4fcb-ae56-dd12c3107555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:03.065910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b40bc64b-c3b1-4fcb-ae56-dd12c3107555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:03.066375 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b40bc64b-c3b1-4fcb-ae56-dd12c3107555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:03.067221 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b40bc64b-c3b1-4fcb-ae56-dd12c3107555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:03.068219 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b40bc64b-c3b1-4fcb-ae56-dd12c3107555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:03.150783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.objects.instance [None req-b40bc64b-c3b1-4fcb-ae56-dd12c3107555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lazy-loading 'services' on Instance uuid 5bff3c23-e302-4420-a1fd-58fd8e80c1a1 {{(pid=107463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:29:03.215552 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b40bc64b-c3b1-4fcb-ae56-dd12c3107555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/os-volume_attachments/ad029823-3e41-4c95-a380-9bb327fbbff5" status: 202 len: 0 microversion: 2.1 time: 0.159436 Jul 19 09:29:03.216189 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 320/615] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Jul 19 09:29:03 2021] DELETE /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1/os-volume_attachments/ad029823-3e41-4c95-a380-9bb327fbbff5 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:29:03.578997 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3bd669bf-5b98-44e2-bf61-d87fc46eaa2e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:03.579632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3bd669bf-5b98-44e2-bf61-d87fc46eaa2e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:03.585364 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3bd669bf-5b98-44e2-bf61-d87fc46eaa2e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:03.585816 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3bd669bf-5b98-44e2-bf61-d87fc46eaa2e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:03.586583 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3bd669bf-5b98-44e2-bf61-d87fc46eaa2e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:03.587021 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3bd669bf-5b98-44e2-bf61-d87fc46eaa2e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:03.716143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3bd669bf-5b98-44e2-bf61-d87fc46eaa2e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:03.724712 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3bd669bf-5b98-44e2-bf61-d87fc46eaa2e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:03.726157 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3bd669bf-5b98-44e2-bf61-d87fc46eaa2e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:03.727328 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3bd669bf-5b98-44e2-bf61-d87fc46eaa2e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152039 Jul 19 09:29:03.727883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 296/616] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:03 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:04.746359 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-09d6e335-bff0-4bf2-ad21-f0b2e6e90279 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:04.747068 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-09d6e335-bff0-4bf2-ad21-f0b2e6e90279 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:04.753608 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09d6e335-bff0-4bf2-ad21-f0b2e6e90279 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:04.754058 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09d6e335-bff0-4bf2-ad21-f0b2e6e90279 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:04.754820 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09d6e335-bff0-4bf2-ad21-f0b2e6e90279 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:04.755285 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09d6e335-bff0-4bf2-ad21-f0b2e6e90279 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:04.883884 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-09d6e335-bff0-4bf2-ad21-f0b2e6e90279 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:04.891920 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-09d6e335-bff0-4bf2-ad21-f0b2e6e90279 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:04.893419 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-09d6e335-bff0-4bf2-ad21-f0b2e6e90279 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:04.894548 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-09d6e335-bff0-4bf2-ad21-f0b2e6e90279 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152240 Jul 19 09:29:04.895129 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 321/617] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:04 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:05.912316 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-042a44aa-c2e7-482e-8fa0-8387e8d5c5e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:05.912918 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-042a44aa-c2e7-482e-8fa0-8387e8d5c5e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:05.918941 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-042a44aa-c2e7-482e-8fa0-8387e8d5c5e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:05.919414 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-042a44aa-c2e7-482e-8fa0-8387e8d5c5e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:05.920171 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-042a44aa-c2e7-482e-8fa0-8387e8d5c5e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:05.920770 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-042a44aa-c2e7-482e-8fa0-8387e8d5c5e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:06.056237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-042a44aa-c2e7-482e-8fa0-8387e8d5c5e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:06.065258 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-042a44aa-c2e7-482e-8fa0-8387e8d5c5e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:06.066778 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-042a44aa-c2e7-482e-8fa0-8387e8d5c5e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:06.067923 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-042a44aa-c2e7-482e-8fa0-8387e8d5c5e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.159325 Jul 19 09:29:06.068463 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 297/618] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:05 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:07.085491 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-05339d1c-0f3b-48fd-84f3-c8f06331c73e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:07.086089 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-05339d1c-0f3b-48fd-84f3-c8f06331c73e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:07.092026 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-05339d1c-0f3b-48fd-84f3-c8f06331c73e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:07.092479 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-05339d1c-0f3b-48fd-84f3-c8f06331c73e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:07.093243 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-05339d1c-0f3b-48fd-84f3-c8f06331c73e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:07.093679 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-05339d1c-0f3b-48fd-84f3-c8f06331c73e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:07.226949 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-05339d1c-0f3b-48fd-84f3-c8f06331c73e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:07.235544 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-05339d1c-0f3b-48fd-84f3-c8f06331c73e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:07.237045 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-05339d1c-0f3b-48fd-84f3-c8f06331c73e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:07.238174 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-05339d1c-0f3b-48fd-84f3-c8f06331c73e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.156599 Jul 19 09:29:07.238732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 322/619] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:07 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:08.256171 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-308f85a4-99ca-419c-b9ee-0d45274e16d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:08.256739 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-308f85a4-99ca-419c-b9ee-0d45274e16d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:08.262539 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-308f85a4-99ca-419c-b9ee-0d45274e16d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:08.263111 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-308f85a4-99ca-419c-b9ee-0d45274e16d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:08.263903 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-308f85a4-99ca-419c-b9ee-0d45274e16d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:08.264384 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-308f85a4-99ca-419c-b9ee-0d45274e16d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:08.397252 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-308f85a4-99ca-419c-b9ee-0d45274e16d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:08.405318 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-308f85a4-99ca-419c-b9ee-0d45274e16d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:08.406905 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-308f85a4-99ca-419c-b9ee-0d45274e16d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:08.408048 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-308f85a4-99ca-419c-b9ee-0d45274e16d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155709 Jul 19 09:29:08.408600 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 298/620] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:08 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:09.426487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-15a6bb99-afd6-4f94-841f-74c3c196cdd2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:09.427106 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-15a6bb99-afd6-4f94-841f-74c3c196cdd2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:09.432785 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-15a6bb99-afd6-4f94-841f-74c3c196cdd2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:09.433227 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-15a6bb99-afd6-4f94-841f-74c3c196cdd2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:09.433978 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-15a6bb99-afd6-4f94-841f-74c3c196cdd2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:09.434404 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-15a6bb99-afd6-4f94-841f-74c3c196cdd2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:09.563590 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-15a6bb99-afd6-4f94-841f-74c3c196cdd2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:09.571826 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-15a6bb99-afd6-4f94-841f-74c3c196cdd2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:09.573331 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-15a6bb99-afd6-4f94-841f-74c3c196cdd2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:09.574477 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-15a6bb99-afd6-4f94-841f-74c3c196cdd2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152130 Jul 19 09:29:09.575052 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 323/621] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:09 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:10.592043 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b26f4b9c-c4ad-47eb-b391-a93aef60258d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:10.592649 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b26f4b9c-c4ad-47eb-b391-a93aef60258d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:10.598402 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b26f4b9c-c4ad-47eb-b391-a93aef60258d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:10.598849 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b26f4b9c-c4ad-47eb-b391-a93aef60258d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:10.599647 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b26f4b9c-c4ad-47eb-b391-a93aef60258d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:10.600086 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b26f4b9c-c4ad-47eb-b391-a93aef60258d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:10.734931 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b26f4b9c-c4ad-47eb-b391-a93aef60258d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:10.743015 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b26f4b9c-c4ad-47eb-b391-a93aef60258d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:10.744540 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b26f4b9c-c4ad-47eb-b391-a93aef60258d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:10.745684 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b26f4b9c-c4ad-47eb-b391-a93aef60258d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.157321 Jul 19 09:29:10.746232 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 299/622] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:10 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:11.765178 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bcec362a-86b7-4d13-a35e-636497c59fcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:11.765739 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bcec362a-86b7-4d13-a35e-636497c59fcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:11.771568 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bcec362a-86b7-4d13-a35e-636497c59fcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:11.772018 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bcec362a-86b7-4d13-a35e-636497c59fcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:11.772797 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bcec362a-86b7-4d13-a35e-636497c59fcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:11.773235 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bcec362a-86b7-4d13-a35e-636497c59fcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:11.901047 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bcec362a-86b7-4d13-a35e-636497c59fcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:11.909629 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bcec362a-86b7-4d13-a35e-636497c59fcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:11.911190 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bcec362a-86b7-4d13-a35e-636497c59fcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:11.912324 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bcec362a-86b7-4d13-a35e-636497c59fcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.150999 Jul 19 09:29:11.912876 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 324/623] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:11 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:12.931019 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e473d78a-f496-4f18-a878-c598c9648c16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:12.931646 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e473d78a-f496-4f18-a878-c598c9648c16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:12.937366 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e473d78a-f496-4f18-a878-c598c9648c16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:12.938361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e473d78a-f496-4f18-a878-c598c9648c16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:12.939154 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e473d78a-f496-4f18-a878-c598c9648c16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:12.939587 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e473d78a-f496-4f18-a878-c598c9648c16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:13.071440 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e473d78a-f496-4f18-a878-c598c9648c16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:13.080067 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e473d78a-f496-4f18-a878-c598c9648c16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:13.081556 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e473d78a-f496-4f18-a878-c598c9648c16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:13.082681 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e473d78a-f496-4f18-a878-c598c9648c16 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155405 Jul 19 09:29:13.083264 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 300/624] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:12 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:14.100339 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3a5d3f65-5657-43e9-b5e9-dda199b4c79d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:14.100943 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3a5d3f65-5657-43e9-b5e9-dda199b4c79d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:14.106676 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3a5d3f65-5657-43e9-b5e9-dda199b4c79d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:14.107157 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3a5d3f65-5657-43e9-b5e9-dda199b4c79d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:14.107929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3a5d3f65-5657-43e9-b5e9-dda199b4c79d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:14.107929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3a5d3f65-5657-43e9-b5e9-dda199b4c79d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:14.239608 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3a5d3f65-5657-43e9-b5e9-dda199b4c79d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:14.247609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3a5d3f65-5657-43e9-b5e9-dda199b4c79d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:14.249097 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3a5d3f65-5657-43e9-b5e9-dda199b4c79d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:14.250892 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3a5d3f65-5657-43e9-b5e9-dda199b4c79d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153551 Jul 19 09:29:14.251371 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 325/625] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:14 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:14.766745 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0bc45c41-f78e-46c1-a283-52aaa60ab7fd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:14.767277 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0bc45c41-f78e-46c1-a283-52aaa60ab7fd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:14.772915 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0bc45c41-f78e-46c1-a283-52aaa60ab7fd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:14.773366 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0bc45c41-f78e-46c1-a283-52aaa60ab7fd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:14.774123 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0bc45c41-f78e-46c1-a283-52aaa60ab7fd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:14.774557 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0bc45c41-f78e-46c1-a283-52aaa60ab7fd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:14.857727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.objects.instance [None req-0bc45c41-f78e-46c1-a283-52aaa60ab7fd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lazy-loading 'services' on Instance uuid a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 {{(pid=107464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:29:14.936469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0bc45c41-f78e-46c1-a283-52aaa60ab7fd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8/os-volume_attachments/d515f9f3-cf05-4226-8186-c9e6317f6ac6" status: 202 len: 0 microversion: 2.1 time: 0.173384 Jul 19 09:29:14.937044 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 301/626] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Jul 19 09:29:14 2021] DELETE /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8/os-volume_attachments/d515f9f3-cf05-4226-8186-c9e6317f6ac6 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:29:15.267714 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9938698f-0785-4bf4-a79f-44e7683d6cf0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:15.268309 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9938698f-0785-4bf4-a79f-44e7683d6cf0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:15.273973 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9938698f-0785-4bf4-a79f-44e7683d6cf0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:15.274426 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9938698f-0785-4bf4-a79f-44e7683d6cf0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:15.275220 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9938698f-0785-4bf4-a79f-44e7683d6cf0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:15.275684 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9938698f-0785-4bf4-a79f-44e7683d6cf0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:15.405698 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9938698f-0785-4bf4-a79f-44e7683d6cf0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:15.414421 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9938698f-0785-4bf4-a79f-44e7683d6cf0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:15.415951 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9938698f-0785-4bf4-a79f-44e7683d6cf0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:15.417347 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9938698f-0785-4bf4-a79f-44e7683d6cf0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153325 Jul 19 09:29:15.417904 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 326/627] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:15 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:16.434659 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-587b5b74-4185-4fe3-abd1-e919499c1287 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:16.435307 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-587b5b74-4185-4fe3-abd1-e919499c1287 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:16.441803 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-587b5b74-4185-4fe3-abd1-e919499c1287 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:16.442241 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-587b5b74-4185-4fe3-abd1-e919499c1287 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:16.442993 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-587b5b74-4185-4fe3-abd1-e919499c1287 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:16.443449 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-587b5b74-4185-4fe3-abd1-e919499c1287 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:16.573467 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-587b5b74-4185-4fe3-abd1-e919499c1287 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:16.581509 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-587b5b74-4185-4fe3-abd1-e919499c1287 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:16.582998 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-587b5b74-4185-4fe3-abd1-e919499c1287 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:16.584141 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-587b5b74-4185-4fe3-abd1-e919499c1287 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153644 Jul 19 09:29:16.584693 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 302/628] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:16 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:17.602392 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b9dc5f39-3dee-4a54-9da7-663055c91c1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:17.602905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b9dc5f39-3dee-4a54-9da7-663055c91c1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:17.608722 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9dc5f39-3dee-4a54-9da7-663055c91c1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:17.609667 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9dc5f39-3dee-4a54-9da7-663055c91c1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:17.610422 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9dc5f39-3dee-4a54-9da7-663055c91c1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:17.610856 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9dc5f39-3dee-4a54-9da7-663055c91c1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:17.743157 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b9dc5f39-3dee-4a54-9da7-663055c91c1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:17.751377 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b9dc5f39-3dee-4a54-9da7-663055c91c1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:17.752881 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b9dc5f39-3dee-4a54-9da7-663055c91c1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:17.754004 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b9dc5f39-3dee-4a54-9da7-663055c91c1c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155382 Jul 19 09:29:17.754566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 327/629] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:17 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:18.772282 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-831a9c26-ebdb-4d51-bd9d-527ad6b0b995 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:18.772880 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-831a9c26-ebdb-4d51-bd9d-527ad6b0b995 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:18.778756 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-831a9c26-ebdb-4d51-bd9d-527ad6b0b995 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:18.779230 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-831a9c26-ebdb-4d51-bd9d-527ad6b0b995 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:18.779983 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-831a9c26-ebdb-4d51-bd9d-527ad6b0b995 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:18.780411 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-831a9c26-ebdb-4d51-bd9d-527ad6b0b995 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:18.912059 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-831a9c26-ebdb-4d51-bd9d-527ad6b0b995 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:18.920319 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-831a9c26-ebdb-4d51-bd9d-527ad6b0b995 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:18.921889 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-831a9c26-ebdb-4d51-bd9d-527ad6b0b995 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:18.923006 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-831a9c26-ebdb-4d51-bd9d-527ad6b0b995 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.154412 Jul 19 09:29:18.923580 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 303/630] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:18 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:19.941370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7dcf94db-fec2-43e1-8360-c86fe3b37716 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:19.941982 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7dcf94db-fec2-43e1-8360-c86fe3b37716 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:19.947782 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7dcf94db-fec2-43e1-8360-c86fe3b37716 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:19.948238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7dcf94db-fec2-43e1-8360-c86fe3b37716 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:19.949000 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7dcf94db-fec2-43e1-8360-c86fe3b37716 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:19.949438 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7dcf94db-fec2-43e1-8360-c86fe3b37716 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:20.077889 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7dcf94db-fec2-43e1-8360-c86fe3b37716 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:20.086072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7dcf94db-fec2-43e1-8360-c86fe3b37716 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:20.087645 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7dcf94db-fec2-43e1-8360-c86fe3b37716 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:20.088778 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7dcf94db-fec2-43e1-8360-c86fe3b37716 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.151716 Jul 19 09:29:20.089341 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 328/631] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:19 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:21.107124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bfa2f02d-3fc1-46c9-b95d-3190c260528f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:21.107730 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bfa2f02d-3fc1-46c9-b95d-3190c260528f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:21.113364 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bfa2f02d-3fc1-46c9-b95d-3190c260528f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:21.113806 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bfa2f02d-3fc1-46c9-b95d-3190c260528f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:21.114559 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bfa2f02d-3fc1-46c9-b95d-3190c260528f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:21.114984 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bfa2f02d-3fc1-46c9-b95d-3190c260528f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:21.248810 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bfa2f02d-3fc1-46c9-b95d-3190c260528f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:21.256908 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bfa2f02d-3fc1-46c9-b95d-3190c260528f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:21.258403 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bfa2f02d-3fc1-46c9-b95d-3190c260528f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:21.259552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bfa2f02d-3fc1-46c9-b95d-3190c260528f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.156143 Jul 19 09:29:21.260128 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 304/632] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:21 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:22.277736 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3c3382b9-852f-4e42-b40f-bf500f550fd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:22.278340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3c3382b9-852f-4e42-b40f-bf500f550fd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:22.284641 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3c3382b9-852f-4e42-b40f-bf500f550fd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:22.285085 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3c3382b9-852f-4e42-b40f-bf500f550fd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:22.285839 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3c3382b9-852f-4e42-b40f-bf500f550fd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:22.286270 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3c3382b9-852f-4e42-b40f-bf500f550fd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:22.418112 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3c3382b9-852f-4e42-b40f-bf500f550fd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:22.426892 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3c3382b9-852f-4e42-b40f-bf500f550fd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:22.428411 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3c3382b9-852f-4e42-b40f-bf500f550fd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:22.429542 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3c3382b9-852f-4e42-b40f-bf500f550fd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155864 Jul 19 09:29:22.430086 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 329/633] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:22 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:23.447177 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6b9a171f-e514-4965-9533-6733fec70d85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:23.447768 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6b9a171f-e514-4965-9533-6733fec70d85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:23.454232 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b9a171f-e514-4965-9533-6733fec70d85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:23.454677 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b9a171f-e514-4965-9533-6733fec70d85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:23.455456 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b9a171f-e514-4965-9533-6733fec70d85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:23.455885 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b9a171f-e514-4965-9533-6733fec70d85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:23.591728 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6b9a171f-e514-4965-9533-6733fec70d85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:23.600519 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6b9a171f-e514-4965-9533-6733fec70d85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:23.602003 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6b9a171f-e514-4965-9533-6733fec70d85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:23.603147 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6b9a171f-e514-4965-9533-6733fec70d85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.159583 Jul 19 09:29:23.603696 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 305/634] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:23 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:24.621211 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a0ec70ae-4603-4a6a-87d9-c12c619da40c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:24.621816 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a0ec70ae-4603-4a6a-87d9-c12c619da40c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:24.627597 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a0ec70ae-4603-4a6a-87d9-c12c619da40c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:24.628046 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a0ec70ae-4603-4a6a-87d9-c12c619da40c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:24.628993 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a0ec70ae-4603-4a6a-87d9-c12c619da40c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:24.629425 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a0ec70ae-4603-4a6a-87d9-c12c619da40c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:24.760451 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a0ec70ae-4603-4a6a-87d9-c12c619da40c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:24.768586 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a0ec70ae-4603-4a6a-87d9-c12c619da40c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:24.770084 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a0ec70ae-4603-4a6a-87d9-c12c619da40c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:24.771245 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a0ec70ae-4603-4a6a-87d9-c12c619da40c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153786 Jul 19 09:29:24.771806 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 330/635] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:24 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:25.789452 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6cfc0466-50db-4e6d-944a-8390bf578b2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:25.790054 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6cfc0466-50db-4e6d-944a-8390bf578b2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:25.796021 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6cfc0466-50db-4e6d-944a-8390bf578b2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:25.797000 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6cfc0466-50db-4e6d-944a-8390bf578b2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:25.797795 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6cfc0466-50db-4e6d-944a-8390bf578b2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:25.798222 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6cfc0466-50db-4e6d-944a-8390bf578b2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:25.929210 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6cfc0466-50db-4e6d-944a-8390bf578b2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:25.937811 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6cfc0466-50db-4e6d-944a-8390bf578b2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:25.939353 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6cfc0466-50db-4e6d-944a-8390bf578b2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:25.940475 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6cfc0466-50db-4e6d-944a-8390bf578b2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.154724 Jul 19 09:29:25.941039 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 306/636] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:25 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:26.958665 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-28d33233-ed41-4889-a8a4-d326afc9711d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:26.959202 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-28d33233-ed41-4889-a8a4-d326afc9711d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:26.965045 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-28d33233-ed41-4889-a8a4-d326afc9711d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:26.965515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-28d33233-ed41-4889-a8a4-d326afc9711d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:26.966261 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-28d33233-ed41-4889-a8a4-d326afc9711d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:26.966696 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-28d33233-ed41-4889-a8a4-d326afc9711d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:27.094786 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-28d33233-ed41-4889-a8a4-d326afc9711d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:27.102843 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-28d33233-ed41-4889-a8a4-d326afc9711d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:27.104376 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-28d33233-ed41-4889-a8a4-d326afc9711d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:27.105504 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-28d33233-ed41-4889-a8a4-d326afc9711d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.150723 Jul 19 09:29:27.106059 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 331/637] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:26 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:28.123489 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b428f000-a741-4493-a2e9-47c3a67e843a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:28.124037 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b428f000-a741-4493-a2e9-47c3a67e843a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:28.129827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b428f000-a741-4493-a2e9-47c3a67e843a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:28.130276 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b428f000-a741-4493-a2e9-47c3a67e843a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:28.131058 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b428f000-a741-4493-a2e9-47c3a67e843a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:28.131500 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b428f000-a741-4493-a2e9-47c3a67e843a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:28.263524 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b428f000-a741-4493-a2e9-47c3a67e843a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:28.271998 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b428f000-a741-4493-a2e9-47c3a67e843a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:28.273491 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b428f000-a741-4493-a2e9-47c3a67e843a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:28.274598 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b428f000-a741-4493-a2e9-47c3a67e843a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.154861 Jul 19 09:29:28.275183 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 307/638] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:28 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:29.293106 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-94552353-8816-442c-b39b-3ff8a80ba4f5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:29.293711 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-94552353-8816-442c-b39b-3ff8a80ba4f5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:29.300032 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-94552353-8816-442c-b39b-3ff8a80ba4f5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:29.300492 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-94552353-8816-442c-b39b-3ff8a80ba4f5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:29.301250 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-94552353-8816-442c-b39b-3ff8a80ba4f5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:29.301685 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-94552353-8816-442c-b39b-3ff8a80ba4f5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:29.433609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-94552353-8816-442c-b39b-3ff8a80ba4f5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:29.442187 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-94552353-8816-442c-b39b-3ff8a80ba4f5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:29.443720 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-94552353-8816-442c-b39b-3ff8a80ba4f5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:29.444879 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-94552353-8816-442c-b39b-3ff8a80ba4f5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155759 Jul 19 09:29:29.445437 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 332/639] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:29 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:30.463804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fa005cb9-2649-4db9-b632-6071fc97139b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:30.464401 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fa005cb9-2649-4db9-b632-6071fc97139b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:30.470797 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa005cb9-2649-4db9-b632-6071fc97139b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:30.471279 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa005cb9-2649-4db9-b632-6071fc97139b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:30.472035 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa005cb9-2649-4db9-b632-6071fc97139b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:30.472464 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa005cb9-2649-4db9-b632-6071fc97139b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:30.609772 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fa005cb9-2649-4db9-b632-6071fc97139b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:30.617875 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fa005cb9-2649-4db9-b632-6071fc97139b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:30.619407 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fa005cb9-2649-4db9-b632-6071fc97139b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:30.620543 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fa005cb9-2649-4db9-b632-6071fc97139b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.160472 Jul 19 09:29:30.621093 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 308/640] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:30 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:31.638231 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2e732dbf-7c09-4879-8a3a-551ff702cc36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:31.638858 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2e732dbf-7c09-4879-8a3a-551ff702cc36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:31.644655 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2e732dbf-7c09-4879-8a3a-551ff702cc36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:31.645099 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2e732dbf-7c09-4879-8a3a-551ff702cc36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:31.645848 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2e732dbf-7c09-4879-8a3a-551ff702cc36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:31.646283 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2e732dbf-7c09-4879-8a3a-551ff702cc36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:31.774757 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2e732dbf-7c09-4879-8a3a-551ff702cc36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:31.783426 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2e732dbf-7c09-4879-8a3a-551ff702cc36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:31.784911 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2e732dbf-7c09-4879-8a3a-551ff702cc36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:31.786033 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2e732dbf-7c09-4879-8a3a-551ff702cc36 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.151522 Jul 19 09:29:31.786569 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 333/641] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:31 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:32.803737 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7b9d8985-eaab-40c2-9e49-27207857984b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:32.804359 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7b9d8985-eaab-40c2-9e49-27207857984b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:32.810232 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b9d8985-eaab-40c2-9e49-27207857984b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:32.810448 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b9d8985-eaab-40c2-9e49-27207857984b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:32.811252 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b9d8985-eaab-40c2-9e49-27207857984b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:32.811753 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b9d8985-eaab-40c2-9e49-27207857984b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:32.958977 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7b9d8985-eaab-40c2-9e49-27207857984b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:32.967187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7b9d8985-eaab-40c2-9e49-27207857984b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:32.968745 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7b9d8985-eaab-40c2-9e49-27207857984b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:32.969882 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7b9d8985-eaab-40c2-9e49-27207857984b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.169762 Jul 19 09:29:32.970437 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 309/642] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:32 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:33.988187 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cf53b280-e205-49a3-8b6e-2b6748681ea6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:33.988812 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-cf53b280-e205-49a3-8b6e-2b6748681ea6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:33.994423 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf53b280-e205-49a3-8b6e-2b6748681ea6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:33.994870 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf53b280-e205-49a3-8b6e-2b6748681ea6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:33.995653 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf53b280-e205-49a3-8b6e-2b6748681ea6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:33.996084 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf53b280-e205-49a3-8b6e-2b6748681ea6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:34.126083 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cf53b280-e205-49a3-8b6e-2b6748681ea6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:34.134431 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cf53b280-e205-49a3-8b6e-2b6748681ea6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:34.135960 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cf53b280-e205-49a3-8b6e-2b6748681ea6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:34.137091 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-cf53b280-e205-49a3-8b6e-2b6748681ea6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152608 Jul 19 09:29:34.137641 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 334/643] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:33 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:35.154927 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c45f386d-2e23-431d-a7a3-f73aa87ca531 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:35.156176 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c45f386d-2e23-431d-a7a3-f73aa87ca531 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:35.162208 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c45f386d-2e23-431d-a7a3-f73aa87ca531 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:35.162754 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c45f386d-2e23-431d-a7a3-f73aa87ca531 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:35.163621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c45f386d-2e23-431d-a7a3-f73aa87ca531 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:35.164138 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c45f386d-2e23-431d-a7a3-f73aa87ca531 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:35.301886 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c45f386d-2e23-431d-a7a3-f73aa87ca531 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:35.309906 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c45f386d-2e23-431d-a7a3-f73aa87ca531 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:35.311418 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c45f386d-2e23-431d-a7a3-f73aa87ca531 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:35.312535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c45f386d-2e23-431d-a7a3-f73aa87ca531 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.161331 Jul 19 09:29:35.313103 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 310/644] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:35 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:36.330925 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-12227e4c-d9ed-46cc-8c3f-e1276437d426 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:36.331571 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-12227e4c-d9ed-46cc-8c3f-e1276437d426 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:36.337334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12227e4c-d9ed-46cc-8c3f-e1276437d426 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:36.337784 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12227e4c-d9ed-46cc-8c3f-e1276437d426 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:36.338539 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12227e4c-d9ed-46cc-8c3f-e1276437d426 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:36.338976 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12227e4c-d9ed-46cc-8c3f-e1276437d426 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:36.473168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-12227e4c-d9ed-46cc-8c3f-e1276437d426 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:36.481249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-12227e4c-d9ed-46cc-8c3f-e1276437d426 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:36.482746 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-12227e4c-d9ed-46cc-8c3f-e1276437d426 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:36.484393 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-12227e4c-d9ed-46cc-8c3f-e1276437d426 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.157852 Jul 19 09:29:36.484947 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 335/645] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:36 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:37.501884 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b345ab7c-ea13-42ac-8b11-844e21c400b1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:37.502489 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b345ab7c-ea13-42ac-8b11-844e21c400b1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:37.508348 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b345ab7c-ea13-42ac-8b11-844e21c400b1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:37.508796 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b345ab7c-ea13-42ac-8b11-844e21c400b1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:37.509560 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b345ab7c-ea13-42ac-8b11-844e21c400b1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:37.509998 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b345ab7c-ea13-42ac-8b11-844e21c400b1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:37.640113 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b345ab7c-ea13-42ac-8b11-844e21c400b1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:37.648118 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b345ab7c-ea13-42ac-8b11-844e21c400b1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:37.649628 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b345ab7c-ea13-42ac-8b11-844e21c400b1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:37.650756 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b345ab7c-ea13-42ac-8b11-844e21c400b1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153084 Jul 19 09:29:37.651353 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 311/646] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:37 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:38.668630 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-29f9d441-2573-40a5-9db7-8c7a519b6563 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:38.669236 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-29f9d441-2573-40a5-9db7-8c7a519b6563 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:38.675525 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-29f9d441-2573-40a5-9db7-8c7a519b6563 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:38.675973 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-29f9d441-2573-40a5-9db7-8c7a519b6563 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:38.676731 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-29f9d441-2573-40a5-9db7-8c7a519b6563 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:38.677162 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-29f9d441-2573-40a5-9db7-8c7a519b6563 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:38.805471 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-29f9d441-2573-40a5-9db7-8c7a519b6563 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:38.814195 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-29f9d441-2573-40a5-9db7-8c7a519b6563 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:38.815762 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-29f9d441-2573-40a5-9db7-8c7a519b6563 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:38.816892 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-29f9d441-2573-40a5-9db7-8c7a519b6563 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152204 Jul 19 09:29:38.817453 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 336/647] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:38 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:39.835063 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d15b026c-1ad4-44dd-a101-5605154348ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:39.835688 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d15b026c-1ad4-44dd-a101-5605154348ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:39.841460 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d15b026c-1ad4-44dd-a101-5605154348ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:39.841907 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d15b026c-1ad4-44dd-a101-5605154348ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:39.843193 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d15b026c-1ad4-44dd-a101-5605154348ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:39.843630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d15b026c-1ad4-44dd-a101-5605154348ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:39.975749 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d15b026c-1ad4-44dd-a101-5605154348ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:39.984316 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d15b026c-1ad4-44dd-a101-5605154348ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:39.985820 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d15b026c-1ad4-44dd-a101-5605154348ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:39.986946 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d15b026c-1ad4-44dd-a101-5605154348ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155675 Jul 19 09:29:39.987537 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 312/648] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:39 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:41.005342 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-aed99fcf-68e3-4016-a896-5315dc5d187d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:41.005983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-aed99fcf-68e3-4016-a896-5315dc5d187d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:41.011844 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aed99fcf-68e3-4016-a896-5315dc5d187d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:41.012294 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aed99fcf-68e3-4016-a896-5315dc5d187d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:41.013048 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aed99fcf-68e3-4016-a896-5315dc5d187d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:41.013484 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aed99fcf-68e3-4016-a896-5315dc5d187d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:41.147996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-aed99fcf-68e3-4016-a896-5315dc5d187d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:41.156502 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-aed99fcf-68e3-4016-a896-5315dc5d187d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:41.157995 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-aed99fcf-68e3-4016-a896-5315dc5d187d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:41.159157 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-aed99fcf-68e3-4016-a896-5315dc5d187d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.157537 Jul 19 09:29:41.159708 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 337/649] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:41 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:42.177531 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6601e4c8-5308-43c8-89b2-682e06d4430d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:42.178142 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6601e4c8-5308-43c8-89b2-682e06d4430d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:42.184069 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6601e4c8-5308-43c8-89b2-682e06d4430d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:42.184515 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6601e4c8-5308-43c8-89b2-682e06d4430d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:42.185269 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6601e4c8-5308-43c8-89b2-682e06d4430d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:42.185698 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6601e4c8-5308-43c8-89b2-682e06d4430d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:42.318682 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6601e4c8-5308-43c8-89b2-682e06d4430d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:42.327557 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6601e4c8-5308-43c8-89b2-682e06d4430d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:42.329076 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6601e4c8-5308-43c8-89b2-682e06d4430d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:42.330217 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6601e4c8-5308-43c8-89b2-682e06d4430d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.156375 Jul 19 09:29:42.330761 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 313/650] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:42 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:43.348268 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-edf2815b-eda0-442b-8770-841d18cabbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:43.348894 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-edf2815b-eda0-442b-8770-841d18cabbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:43.354506 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-edf2815b-eda0-442b-8770-841d18cabbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:43.354956 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-edf2815b-eda0-442b-8770-841d18cabbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:43.355752 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-edf2815b-eda0-442b-8770-841d18cabbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:43.356184 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-edf2815b-eda0-442b-8770-841d18cabbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:43.487600 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-edf2815b-eda0-442b-8770-841d18cabbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:43.495716 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-edf2815b-eda0-442b-8770-841d18cabbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:43.497250 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-edf2815b-eda0-442b-8770-841d18cabbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:43.498393 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-edf2815b-eda0-442b-8770-841d18cabbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153776 Jul 19 09:29:43.499510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 338/651] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:43 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:44.516951 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7b7e2ebf-81eb-42f5-b729-7e78eb8e7dbe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:44.517561 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7b7e2ebf-81eb-42f5-b729-7e78eb8e7dbe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:44.523227 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b7e2ebf-81eb-42f5-b729-7e78eb8e7dbe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:44.523675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b7e2ebf-81eb-42f5-b729-7e78eb8e7dbe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:44.524429 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b7e2ebf-81eb-42f5-b729-7e78eb8e7dbe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:44.524865 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b7e2ebf-81eb-42f5-b729-7e78eb8e7dbe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:44.655329 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7b7e2ebf-81eb-42f5-b729-7e78eb8e7dbe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:44.663972 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7b7e2ebf-81eb-42f5-b729-7e78eb8e7dbe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:44.665764 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7b7e2ebf-81eb-42f5-b729-7e78eb8e7dbe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:44.667192 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7b7e2ebf-81eb-42f5-b729-7e78eb8e7dbe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153963 Jul 19 09:29:44.667897 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 314/652] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:44 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:45.685487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8e10cd88-f891-41e9-8a59-4ee27cd5d875 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:45.686216 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8e10cd88-f891-41e9-8a59-4ee27cd5d875 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:45.691736 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8e10cd88-f891-41e9-8a59-4ee27cd5d875 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:45.692202 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8e10cd88-f891-41e9-8a59-4ee27cd5d875 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:45.692946 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8e10cd88-f891-41e9-8a59-4ee27cd5d875 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:45.693379 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8e10cd88-f891-41e9-8a59-4ee27cd5d875 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:45.824710 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8e10cd88-f891-41e9-8a59-4ee27cd5d875 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:45.833279 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8e10cd88-f891-41e9-8a59-4ee27cd5d875 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:45.834761 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8e10cd88-f891-41e9-8a59-4ee27cd5d875 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:45.835902 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8e10cd88-f891-41e9-8a59-4ee27cd5d875 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.154120 Jul 19 09:29:45.836461 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 339/653] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:45 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:46.853712 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-89ca978f-14ec-47e2-b40d-462950f175a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:46.854313 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-89ca978f-14ec-47e2-b40d-462950f175a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:46.861158 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-89ca978f-14ec-47e2-b40d-462950f175a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:46.861606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-89ca978f-14ec-47e2-b40d-462950f175a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:46.862375 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-89ca978f-14ec-47e2-b40d-462950f175a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:46.862809 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-89ca978f-14ec-47e2-b40d-462950f175a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:46.998004 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-89ca978f-14ec-47e2-b40d-462950f175a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:47.006917 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-89ca978f-14ec-47e2-b40d-462950f175a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:47.008388 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-89ca978f-14ec-47e2-b40d-462950f175a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:47.009523 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-89ca978f-14ec-47e2-b40d-462950f175a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.159580 Jul 19 09:29:47.010075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 315/654] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:46 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:48.028577 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b6ed321e-30d4-42dc-aebd-4bc9b7f18536 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:48.029181 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b6ed321e-30d4-42dc-aebd-4bc9b7f18536 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:48.034958 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6ed321e-30d4-42dc-aebd-4bc9b7f18536 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:48.035440 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6ed321e-30d4-42dc-aebd-4bc9b7f18536 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:48.036201 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6ed321e-30d4-42dc-aebd-4bc9b7f18536 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:48.036630 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6ed321e-30d4-42dc-aebd-4bc9b7f18536 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:48.168208 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b6ed321e-30d4-42dc-aebd-4bc9b7f18536 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:48.176333 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b6ed321e-30d4-42dc-aebd-4bc9b7f18536 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:48.177864 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b6ed321e-30d4-42dc-aebd-4bc9b7f18536 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:48.178986 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b6ed321e-30d4-42dc-aebd-4bc9b7f18536 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.154239 Jul 19 09:29:48.179567 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 340/655] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:48 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:49.197238 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-511fe31d-8491-4296-832b-ed3681779f34 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:49.197846 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-511fe31d-8491-4296-832b-ed3681779f34 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:49.204129 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-511fe31d-8491-4296-832b-ed3681779f34 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:49.204571 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-511fe31d-8491-4296-832b-ed3681779f34 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:49.205322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-511fe31d-8491-4296-832b-ed3681779f34 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:49.205747 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-511fe31d-8491-4296-832b-ed3681779f34 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:49.335851 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-511fe31d-8491-4296-832b-ed3681779f34 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:49.344485 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-511fe31d-8491-4296-832b-ed3681779f34 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:49.345999 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-511fe31d-8491-4296-832b-ed3681779f34 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:49.347164 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-511fe31d-8491-4296-832b-ed3681779f34 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153546 Jul 19 09:29:49.347728 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 316/656] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:49 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:50.365065 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-eeff2489-34ce-41f7-be3f-811ca4ba57ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:50.365615 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-eeff2489-34ce-41f7-be3f-811ca4ba57ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:50.371417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eeff2489-34ce-41f7-be3f-811ca4ba57ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:50.371868 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eeff2489-34ce-41f7-be3f-811ca4ba57ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:50.372635 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eeff2489-34ce-41f7-be3f-811ca4ba57ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:50.373070 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eeff2489-34ce-41f7-be3f-811ca4ba57ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:50.504360 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-eeff2489-34ce-41f7-be3f-811ca4ba57ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:50.512451 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-eeff2489-34ce-41f7-be3f-811ca4ba57ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:50.513937 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-eeff2489-34ce-41f7-be3f-811ca4ba57ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:50.515059 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-eeff2489-34ce-41f7-be3f-811ca4ba57ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153800 Jul 19 09:29:50.515622 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 341/657] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:50 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:51.533469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-371849c9-7edc-4d0d-89ef-33cfe25183f7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:51.534081 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-371849c9-7edc-4d0d-89ef-33cfe25183f7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:51.539865 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-371849c9-7edc-4d0d-89ef-33cfe25183f7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:51.540314 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-371849c9-7edc-4d0d-89ef-33cfe25183f7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:51.541331 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-371849c9-7edc-4d0d-89ef-33cfe25183f7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:51.541762 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-371849c9-7edc-4d0d-89ef-33cfe25183f7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:51.670787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-371849c9-7edc-4d0d-89ef-33cfe25183f7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:51.678962 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-371849c9-7edc-4d0d-89ef-33cfe25183f7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:51.680484 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-371849c9-7edc-4d0d-89ef-33cfe25183f7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:51.681644 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-371849c9-7edc-4d0d-89ef-33cfe25183f7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152463 Jul 19 09:29:51.682211 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 317/658] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:51 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:52.700208 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-44d39aba-0506-41c7-ba41-b90eb16fba11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:52.700809 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-44d39aba-0506-41c7-ba41-b90eb16fba11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:52.707130 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44d39aba-0506-41c7-ba41-b90eb16fba11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:52.707581 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44d39aba-0506-41c7-ba41-b90eb16fba11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:52.708331 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44d39aba-0506-41c7-ba41-b90eb16fba11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:52.708759 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44d39aba-0506-41c7-ba41-b90eb16fba11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:53.038305 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-44d39aba-0506-41c7-ba41-b90eb16fba11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:53.046928 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-44d39aba-0506-41c7-ba41-b90eb16fba11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:53.048604 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-44d39aba-0506-41c7-ba41-b90eb16fba11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:53.049825 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-44d39aba-0506-41c7-ba41-b90eb16fba11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.353313 Jul 19 09:29:53.050625 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 342/659] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:52 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:54.067780 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3811fae3-d730-4c88-a5e7-01ce8c0f5644 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:54.068383 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3811fae3-d730-4c88-a5e7-01ce8c0f5644 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:54.074113 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3811fae3-d730-4c88-a5e7-01ce8c0f5644 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:54.074564 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3811fae3-d730-4c88-a5e7-01ce8c0f5644 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:54.075353 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3811fae3-d730-4c88-a5e7-01ce8c0f5644 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:54.075790 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3811fae3-d730-4c88-a5e7-01ce8c0f5644 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:54.212063 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3811fae3-d730-4c88-a5e7-01ce8c0f5644 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:54.220182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3811fae3-d730-4c88-a5e7-01ce8c0f5644 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:54.221678 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3811fae3-d730-4c88-a5e7-01ce8c0f5644 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:54.222807 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3811fae3-d730-4c88-a5e7-01ce8c0f5644 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.158873 Jul 19 09:29:54.223405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 318/660] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:54 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:55.240786 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7a4bbee2-1120-4b7b-8fe8-0aa301362640 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:55.241395 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7a4bbee2-1120-4b7b-8fe8-0aa301362640 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:55.247167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7a4bbee2-1120-4b7b-8fe8-0aa301362640 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:55.247625 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7a4bbee2-1120-4b7b-8fe8-0aa301362640 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:55.248388 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7a4bbee2-1120-4b7b-8fe8-0aa301362640 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:55.248873 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7a4bbee2-1120-4b7b-8fe8-0aa301362640 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:55.377155 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7a4bbee2-1120-4b7b-8fe8-0aa301362640 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:55.385169 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7a4bbee2-1120-4b7b-8fe8-0aa301362640 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:55.386660 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7a4bbee2-1120-4b7b-8fe8-0aa301362640 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:55.387824 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7a4bbee2-1120-4b7b-8fe8-0aa301362640 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.150765 Jul 19 09:29:55.388381 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 343/661] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:55 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:56.405758 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-12d9e00f-169a-4bc9-a45e-5818d29eb6e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:56.406366 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-12d9e00f-169a-4bc9-a45e-5818d29eb6e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:56.412194 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12d9e00f-169a-4bc9-a45e-5818d29eb6e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:56.412643 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12d9e00f-169a-4bc9-a45e-5818d29eb6e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:56.413435 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12d9e00f-169a-4bc9-a45e-5818d29eb6e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:56.413871 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12d9e00f-169a-4bc9-a45e-5818d29eb6e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:56.546560 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-12d9e00f-169a-4bc9-a45e-5818d29eb6e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:56.554571 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-12d9e00f-169a-4bc9-a45e-5818d29eb6e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:56.556088 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-12d9e00f-169a-4bc9-a45e-5818d29eb6e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:56.557203 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-12d9e00f-169a-4bc9-a45e-5818d29eb6e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155598 Jul 19 09:29:56.557757 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 319/662] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:56 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:57.575667 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-12fd9bdc-a6d2-4b80-8716-d31ee952504e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:57.576204 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-12fd9bdc-a6d2-4b80-8716-d31ee952504e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:57.581949 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12fd9bdc-a6d2-4b80-8716-d31ee952504e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:57.582401 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12fd9bdc-a6d2-4b80-8716-d31ee952504e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:57.583189 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12fd9bdc-a6d2-4b80-8716-d31ee952504e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:57.583629 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-12fd9bdc-a6d2-4b80-8716-d31ee952504e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:57.719195 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-12fd9bdc-a6d2-4b80-8716-d31ee952504e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:57.727704 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-12fd9bdc-a6d2-4b80-8716-d31ee952504e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:57.729186 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-12fd9bdc-a6d2-4b80-8716-d31ee952504e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:57.730304 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-12fd9bdc-a6d2-4b80-8716-d31ee952504e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.158449 Jul 19 09:29:57.730861 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 344/663] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:57 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:58.750026 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ccbe1da4-81d1-4d69-a01d-5cfc5a2d2b9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:58.750710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ccbe1da4-81d1-4d69-a01d-5cfc5a2d2b9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:58.756610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ccbe1da4-81d1-4d69-a01d-5cfc5a2d2b9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:58.757051 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ccbe1da4-81d1-4d69-a01d-5cfc5a2d2b9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:58.757804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ccbe1da4-81d1-4d69-a01d-5cfc5a2d2b9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:58.758231 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ccbe1da4-81d1-4d69-a01d-5cfc5a2d2b9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:58.891846 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ccbe1da4-81d1-4d69-a01d-5cfc5a2d2b9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:58.899861 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ccbe1da4-81d1-4d69-a01d-5cfc5a2d2b9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:58.901349 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ccbe1da4-81d1-4d69-a01d-5cfc5a2d2b9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:29:58.902497 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ccbe1da4-81d1-4d69-a01d-5cfc5a2d2b9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.157511 Jul 19 09:29:58.903055 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 320/664] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:58 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:29:59.920844 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-406f5fda-95cd-4706-89db-5fa0d1decf95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:29:59.921444 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-406f5fda-95cd-4706-89db-5fa0d1decf95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:29:59.927259 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-406f5fda-95cd-4706-89db-5fa0d1decf95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:59.927701 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-406f5fda-95cd-4706-89db-5fa0d1decf95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:29:59.928448 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-406f5fda-95cd-4706-89db-5fa0d1decf95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:29:59.928874 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-406f5fda-95cd-4706-89db-5fa0d1decf95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:00.057139 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-406f5fda-95cd-4706-89db-5fa0d1decf95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:00.065740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-406f5fda-95cd-4706-89db-5fa0d1decf95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:00.067269 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-406f5fda-95cd-4706-89db-5fa0d1decf95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:00.068408 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-406f5fda-95cd-4706-89db-5fa0d1decf95 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.151489 Jul 19 09:30:00.068961 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 345/665] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:29:59 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:01.087285 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-60123989-a8cc-48eb-b9a2-60b9e4406c45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:01.087896 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-60123989-a8cc-48eb-b9a2-60b9e4406c45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:01.094156 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-60123989-a8cc-48eb-b9a2-60b9e4406c45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:01.094601 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-60123989-a8cc-48eb-b9a2-60b9e4406c45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:01.095395 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-60123989-a8cc-48eb-b9a2-60b9e4406c45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:01.095826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-60123989-a8cc-48eb-b9a2-60b9e4406c45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:01.225735 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-60123989-a8cc-48eb-b9a2-60b9e4406c45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:01.234526 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-60123989-a8cc-48eb-b9a2-60b9e4406c45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:01.236045 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-60123989-a8cc-48eb-b9a2-60b9e4406c45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:01.237171 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-60123989-a8cc-48eb-b9a2-60b9e4406c45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153621 Jul 19 09:30:01.237726 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 321/666] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:01 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:30:02.254707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-daec3f52-15fd-4ee2-9f0d-c7e1fef5ff3b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:02.255380 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-daec3f52-15fd-4ee2-9f0d-c7e1fef5ff3b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:02.261226 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-daec3f52-15fd-4ee2-9f0d-c7e1fef5ff3b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:02.261716 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-daec3f52-15fd-4ee2-9f0d-c7e1fef5ff3b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:02.262483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-daec3f52-15fd-4ee2-9f0d-c7e1fef5ff3b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:02.262922 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-daec3f52-15fd-4ee2-9f0d-c7e1fef5ff3b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:02.399707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-daec3f52-15fd-4ee2-9f0d-c7e1fef5ff3b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:02.409115 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-daec3f52-15fd-4ee2-9f0d-c7e1fef5ff3b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:02.410734 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-daec3f52-15fd-4ee2-9f0d-c7e1fef5ff3b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:02.411907 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-daec3f52-15fd-4ee2-9f0d-c7e1fef5ff3b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.160937 Jul 19 09:30:02.412472 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 346/667] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:02 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:03.429481 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-59737b23-bcc6-410e-b2d6-e1047a2182dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:03.430374 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-59737b23-bcc6-410e-b2d6-e1047a2182dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:03.436806 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-59737b23-bcc6-410e-b2d6-e1047a2182dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:03.437462 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-59737b23-bcc6-410e-b2d6-e1047a2182dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:03.438235 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-59737b23-bcc6-410e-b2d6-e1047a2182dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:03.438838 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-59737b23-bcc6-410e-b2d6-e1047a2182dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:03.577556 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-59737b23-bcc6-410e-b2d6-e1047a2182dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:03.585926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-59737b23-bcc6-410e-b2d6-e1047a2182dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:03.587478 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-59737b23-bcc6-410e-b2d6-e1047a2182dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:03.588614 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-59737b23-bcc6-410e-b2d6-e1047a2182dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.162818 Jul 19 09:30:03.589189 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 322/668] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:03 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:04.606428 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ece30ecd-2ff4-418d-a042-c368fea6611b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:04.607063 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ece30ecd-2ff4-418d-a042-c368fea6611b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:04.613378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ece30ecd-2ff4-418d-a042-c368fea6611b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:04.613831 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ece30ecd-2ff4-418d-a042-c368fea6611b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:04.614597 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ece30ecd-2ff4-418d-a042-c368fea6611b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:04.615093 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ece30ecd-2ff4-418d-a042-c368fea6611b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:04.751254 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ece30ecd-2ff4-418d-a042-c368fea6611b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:04.762948 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ece30ecd-2ff4-418d-a042-c368fea6611b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:04.765045 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ece30ecd-2ff4-418d-a042-c368fea6611b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:04.766232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ece30ecd-2ff4-418d-a042-c368fea6611b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.163607 Jul 19 09:30:04.766785 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 347/669] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:04 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:05.783883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-152d9f52-fbdb-4a83-868f-970d33e94a5a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:05.784492 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-152d9f52-fbdb-4a83-868f-970d33e94a5a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:05.790292 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-152d9f52-fbdb-4a83-868f-970d33e94a5a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:05.790997 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-152d9f52-fbdb-4a83-868f-970d33e94a5a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:05.791840 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-152d9f52-fbdb-4a83-868f-970d33e94a5a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:05.792279 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-152d9f52-fbdb-4a83-868f-970d33e94a5a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:05.929574 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-152d9f52-fbdb-4a83-868f-970d33e94a5a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:05.937663 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-152d9f52-fbdb-4a83-868f-970d33e94a5a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:05.939197 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-152d9f52-fbdb-4a83-868f-970d33e94a5a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:05.940331 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-152d9f52-fbdb-4a83-868f-970d33e94a5a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.160081 Jul 19 09:30:05.940892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 323/670] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:05 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:06.958181 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-69f46e34-d684-4e21-be97-bff73c278ded tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:06.958782 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-69f46e34-d684-4e21-be97-bff73c278ded tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:06.964401 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69f46e34-d684-4e21-be97-bff73c278ded tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:06.964844 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69f46e34-d684-4e21-be97-bff73c278ded tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:06.965627 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69f46e34-d684-4e21-be97-bff73c278ded tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:06.966076 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69f46e34-d684-4e21-be97-bff73c278ded tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:07.096067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-69f46e34-d684-4e21-be97-bff73c278ded tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:07.104049 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-69f46e34-d684-4e21-be97-bff73c278ded tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:07.105560 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-69f46e34-d684-4e21-be97-bff73c278ded tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:07.106730 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-69f46e34-d684-4e21-be97-bff73c278ded tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152333 Jul 19 09:30:07.107831 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 348/671] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:06 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:08.124977 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-943c6927-7b72-4875-ade4-5309f89d58fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:08.125527 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-943c6927-7b72-4875-ade4-5309f89d58fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:08.131570 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-943c6927-7b72-4875-ade4-5309f89d58fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:08.132019 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-943c6927-7b72-4875-ade4-5309f89d58fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:08.132775 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-943c6927-7b72-4875-ade4-5309f89d58fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:08.133206 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-943c6927-7b72-4875-ade4-5309f89d58fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:08.274928 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-943c6927-7b72-4875-ade4-5309f89d58fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:08.283939 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-943c6927-7b72-4875-ade4-5309f89d58fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:08.285574 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-943c6927-7b72-4875-ade4-5309f89d58fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:08.286716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-943c6927-7b72-4875-ade4-5309f89d58fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.165635 Jul 19 09:30:08.287308 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 324/672] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:08 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:09.305514 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c63f79dc-990c-4418-808f-32a245785bf4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:09.306114 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c63f79dc-990c-4418-808f-32a245785bf4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:09.312105 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c63f79dc-990c-4418-808f-32a245785bf4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:09.312583 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c63f79dc-990c-4418-808f-32a245785bf4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:09.313379 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c63f79dc-990c-4418-808f-32a245785bf4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:09.313816 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c63f79dc-990c-4418-808f-32a245785bf4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:09.446005 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c63f79dc-990c-4418-808f-32a245785bf4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:09.454618 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c63f79dc-990c-4418-808f-32a245785bf4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:09.456151 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c63f79dc-990c-4418-808f-32a245785bf4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:09.457285 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c63f79dc-990c-4418-808f-32a245785bf4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155535 Jul 19 09:30:09.457848 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 349/673] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:09 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:10.475778 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-24992cb3-e0f2-4bf2-ae26-ed016493c253 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:10.476383 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-24992cb3-e0f2-4bf2-ae26-ed016493c253 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:10.482718 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-24992cb3-e0f2-4bf2-ae26-ed016493c253 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:10.483198 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-24992cb3-e0f2-4bf2-ae26-ed016493c253 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:10.483999 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-24992cb3-e0f2-4bf2-ae26-ed016493c253 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:10.484433 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-24992cb3-e0f2-4bf2-ae26-ed016493c253 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:10.617261 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-24992cb3-e0f2-4bf2-ae26-ed016493c253 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:10.625280 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-24992cb3-e0f2-4bf2-ae26-ed016493c253 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:10.626778 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-24992cb3-e0f2-4bf2-ae26-ed016493c253 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:10.627929 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-24992cb3-e0f2-4bf2-ae26-ed016493c253 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155860 Jul 19 09:30:10.628490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 325/674] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:10 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:11.645802 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a8a1f140-8908-465d-aed8-7fb7316519e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:11.646405 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a8a1f140-8908-465d-aed8-7fb7316519e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:11.652251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a8a1f140-8908-465d-aed8-7fb7316519e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:11.652701 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a8a1f140-8908-465d-aed8-7fb7316519e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:11.653462 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a8a1f140-8908-465d-aed8-7fb7316519e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:11.653899 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a8a1f140-8908-465d-aed8-7fb7316519e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:11.782877 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a8a1f140-8908-465d-aed8-7fb7316519e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:11.791280 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a8a1f140-8908-465d-aed8-7fb7316519e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:11.792772 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a8a1f140-8908-465d-aed8-7fb7316519e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:11.793907 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a8a1f140-8908-465d-aed8-7fb7316519e9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.151795 Jul 19 09:30:11.794970 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 350/675] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:11 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:30:12.812978 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7b9e1675-1053-46d1-8de1-c039db0d70f9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:12.813691 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7b9e1675-1053-46d1-8de1-c039db0d70f9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:12.819753 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b9e1675-1053-46d1-8de1-c039db0d70f9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:12.820274 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b9e1675-1053-46d1-8de1-c039db0d70f9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:12.821143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b9e1675-1053-46d1-8de1-c039db0d70f9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:12.821644 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b9e1675-1053-46d1-8de1-c039db0d70f9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:13.040592 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7b9e1675-1053-46d1-8de1-c039db0d70f9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:13.049510 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7b9e1675-1053-46d1-8de1-c039db0d70f9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:13.051195 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7b9e1675-1053-46d1-8de1-c039db0d70f9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:13.052334 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7b9e1675-1053-46d1-8de1-c039db0d70f9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.243631 Jul 19 09:30:13.052892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 326/676] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:12 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:14.070695 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4c445163-ef3e-4150-a465-87072f69d6df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:14.071478 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4c445163-ef3e-4150-a465-87072f69d6df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:14.077951 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4c445163-ef3e-4150-a465-87072f69d6df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:14.078595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4c445163-ef3e-4150-a465-87072f69d6df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:14.079429 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4c445163-ef3e-4150-a465-87072f69d6df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:14.079869 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4c445163-ef3e-4150-a465-87072f69d6df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:14.271355 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4c445163-ef3e-4150-a465-87072f69d6df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:14.279578 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4c445163-ef3e-4150-a465-87072f69d6df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:14.281078 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4c445163-ef3e-4150-a465-87072f69d6df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:14.282203 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4c445163-ef3e-4150-a465-87072f69d6df tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.216265 Jul 19 09:30:14.282758 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 351/677] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:14 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:15.300567 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-793bd02a-b0b3-4544-b6a6-2433b4aa1f30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:15.301217 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-793bd02a-b0b3-4544-b6a6-2433b4aa1f30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:15.307377 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-793bd02a-b0b3-4544-b6a6-2433b4aa1f30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:15.307851 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-793bd02a-b0b3-4544-b6a6-2433b4aa1f30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:15.308651 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-793bd02a-b0b3-4544-b6a6-2433b4aa1f30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:15.309318 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-793bd02a-b0b3-4544-b6a6-2433b4aa1f30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:15.440608 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-793bd02a-b0b3-4544-b6a6-2433b4aa1f30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:15.448823 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-793bd02a-b0b3-4544-b6a6-2433b4aa1f30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:15.450813 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-793bd02a-b0b3-4544-b6a6-2433b4aa1f30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:15.451974 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-793bd02a-b0b3-4544-b6a6-2433b4aa1f30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155383 Jul 19 09:30:15.452532 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 327/678] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:15 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:16.470377 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-21b4b427-23ea-4a96-b8de-37192ee3634e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:16.470984 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-21b4b427-23ea-4a96-b8de-37192ee3634e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:16.476803 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-21b4b427-23ea-4a96-b8de-37192ee3634e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:16.477245 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-21b4b427-23ea-4a96-b8de-37192ee3634e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:16.477996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-21b4b427-23ea-4a96-b8de-37192ee3634e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:16.478425 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-21b4b427-23ea-4a96-b8de-37192ee3634e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:16.611725 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-21b4b427-23ea-4a96-b8de-37192ee3634e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:16.621881 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-21b4b427-23ea-4a96-b8de-37192ee3634e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:16.623435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-21b4b427-23ea-4a96-b8de-37192ee3634e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:16.624580 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-21b4b427-23ea-4a96-b8de-37192ee3634e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.158474 Jul 19 09:30:16.625134 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 352/679] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:16 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:17.428386 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d2aec578-6103-41be-a4d8-34a803f45f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:30:17.428906 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d2aec578-6103-41be-a4d8-34a803f45f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:17.434884 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d2aec578-6103-41be-a4d8-34a803f45f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:17.435365 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d2aec578-6103-41be-a4d8-34a803f45f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:17.436124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d2aec578-6103-41be-a4d8-34a803f45f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:17.436551 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d2aec578-6103-41be-a4d8-34a803f45f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:17.458441 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.objects.instance [None req-d2aec578-6103-41be-a4d8-34a803f45f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lazy-loading 'flavor' on Instance uuid ee02e36e-7587-4ab3-b367-08e1c9b26c69 {{(pid=107464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:30:17.524128 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d2aec578-6103-41be-a4d8-34a803f45f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "POST /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69/action" status: 202 len: 0 microversion: 2.1 time: 0.099219 Jul 19 09:30:17.524710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 328/680] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:30:17 2021] POST /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:30:17.533478 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-32f12adb-af63-4d00-b0b8-eebadfdaa0b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:17.534084 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-32f12adb-af63-4d00-b0b8-eebadfdaa0b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:17.541304 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-32f12adb-af63-4d00-b0b8-eebadfdaa0b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:17.541756 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-32f12adb-af63-4d00-b0b8-eebadfdaa0b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:17.542537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-32f12adb-af63-4d00-b0b8-eebadfdaa0b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:17.542980 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-32f12adb-af63-4d00-b0b8-eebadfdaa0b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:17.642894 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2cd32618-b6da-46b1-af09-756011fceb91 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:17.643629 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2cd32618-b6da-46b1-af09-756011fceb91 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:17.651422 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2cd32618-b6da-46b1-af09-756011fceb91 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:17.651868 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2cd32618-b6da-46b1-af09-756011fceb91 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:17.652645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2cd32618-b6da-46b1-af09-756011fceb91 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:17.653083 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2cd32618-b6da-46b1-af09-756011fceb91 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:17.674926 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-32f12adb-af63-4d00-b0b8-eebadfdaa0b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:17.682385 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-32f12adb-af63-4d00-b0b8-eebadfdaa0b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152575 Jul 19 09:30:17.683062 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 353/681] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:17 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:30:17.788979 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2cd32618-b6da-46b1-af09-756011fceb91 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:17.797387 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2cd32618-b6da-46b1-af09-756011fceb91 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:17.798901 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2cd32618-b6da-46b1-af09-756011fceb91 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:17.800064 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2cd32618-b6da-46b1-af09-756011fceb91 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.161210 Jul 19 09:30:17.800623 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 329/682] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:17 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:30:18.699378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a1ea574a-2574-40f5-8783-0476db391b45 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:18.700004 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a1ea574a-2574-40f5-8783-0476db391b45 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:18.706021 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a1ea574a-2574-40f5-8783-0476db391b45 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:18.706466 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a1ea574a-2574-40f5-8783-0476db391b45 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:18.707260 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a1ea574a-2574-40f5-8783-0476db391b45 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:18.707690 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a1ea574a-2574-40f5-8783-0476db391b45 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:18.818095 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1d9babed-00db-4d72-957e-7c1616112987 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:18.818703 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1d9babed-00db-4d72-957e-7c1616112987 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:18.824467 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1d9babed-00db-4d72-957e-7c1616112987 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:18.824916 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1d9babed-00db-4d72-957e-7c1616112987 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:18.825689 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1d9babed-00db-4d72-957e-7c1616112987 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:18.826124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1d9babed-00db-4d72-957e-7c1616112987 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:18.841855 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a1ea574a-2574-40f5-8783-0476db391b45 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:18.849141 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a1ea574a-2574-40f5-8783-0476db391b45 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.153463 Jul 19 09:30:18.849713 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 354/683] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:18 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:18.957786 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1d9babed-00db-4d72-957e-7c1616112987 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:18.966437 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1d9babed-00db-4d72-957e-7c1616112987 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:18.967974 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1d9babed-00db-4d72-957e-7c1616112987 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:18.969096 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1d9babed-00db-4d72-957e-7c1616112987 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.154620 Jul 19 09:30:18.969658 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 330/684] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:18 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:30:19.866574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-93b9869e-6a13-46c3-8435-dc8cad3fb4d1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:19.867151 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-93b9869e-6a13-46c3-8435-dc8cad3fb4d1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:19.873583 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-93b9869e-6a13-46c3-8435-dc8cad3fb4d1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:19.874062 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-93b9869e-6a13-46c3-8435-dc8cad3fb4d1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:19.874833 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-93b9869e-6a13-46c3-8435-dc8cad3fb4d1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:19.875305 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-93b9869e-6a13-46c3-8435-dc8cad3fb4d1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:19.987127 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bf59e4c9-bebf-44de-bd85-a7f0f9e54092 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:19.987804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bf59e4c9-bebf-44de-bd85-a7f0f9e54092 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:19.993474 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf59e4c9-bebf-44de-bd85-a7f0f9e54092 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:19.993919 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf59e4c9-bebf-44de-bd85-a7f0f9e54092 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:19.994868 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf59e4c9-bebf-44de-bd85-a7f0f9e54092 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:19.995341 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf59e4c9-bebf-44de-bd85-a7f0f9e54092 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:20.006425 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-93b9869e-6a13-46c3-8435-dc8cad3fb4d1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:20.013732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-93b9869e-6a13-46c3-8435-dc8cad3fb4d1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.150911 Jul 19 09:30:20.014298 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 355/685] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:19 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:20.130338 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bf59e4c9-bebf-44de-bd85-a7f0f9e54092 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:20.139053 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bf59e4c9-bebf-44de-bd85-a7f0f9e54092 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:20.140575 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bf59e4c9-bebf-44de-bd85-a7f0f9e54092 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:20.141710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bf59e4c9-bebf-44de-bd85-a7f0f9e54092 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.158419 Jul 19 09:30:20.142259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 331/686] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:19 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:30:21.030621 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6a5933ef-cffd-4ee7-9862-b3972e44267f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:21.031279 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6a5933ef-cffd-4ee7-9862-b3972e44267f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:21.037367 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6a5933ef-cffd-4ee7-9862-b3972e44267f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:21.037828 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6a5933ef-cffd-4ee7-9862-b3972e44267f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:21.038596 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6a5933ef-cffd-4ee7-9862-b3972e44267f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:21.039064 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6a5933ef-cffd-4ee7-9862-b3972e44267f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:21.159710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f955fae9-dfa9-48db-9ecb-a1c2f91160d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:21.160315 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f955fae9-dfa9-48db-9ecb-a1c2f91160d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:21.166749 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f955fae9-dfa9-48db-9ecb-a1c2f91160d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:21.167586 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f955fae9-dfa9-48db-9ecb-a1c2f91160d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:21.167986 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f955fae9-dfa9-48db-9ecb-a1c2f91160d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:21.168417 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f955fae9-dfa9-48db-9ecb-a1c2f91160d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:21.171781 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6a5933ef-cffd-4ee7-9862-b3972e44267f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:21.178714 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6a5933ef-cffd-4ee7-9862-b3972e44267f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152329 Jul 19 09:30:21.179311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 356/687] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:21 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:21.298462 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f955fae9-dfa9-48db-9ecb-a1c2f91160d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:21.306629 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f955fae9-dfa9-48db-9ecb-a1c2f91160d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:21.308168 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f955fae9-dfa9-48db-9ecb-a1c2f91160d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:21.309295 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f955fae9-dfa9-48db-9ecb-a1c2f91160d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153372 Jul 19 09:30:21.310418 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 332/688] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:21 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:30:22.196007 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-31e04c51-71ed-44d5-90a5-fab9b4aeb259 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:22.196624 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-31e04c51-71ed-44d5-90a5-fab9b4aeb259 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:22.202446 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-31e04c51-71ed-44d5-90a5-fab9b4aeb259 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:22.202897 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-31e04c51-71ed-44d5-90a5-fab9b4aeb259 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:22.203704 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-31e04c51-71ed-44d5-90a5-fab9b4aeb259 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:22.204141 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-31e04c51-71ed-44d5-90a5-fab9b4aeb259 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:22.328338 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4249efac-ba82-4055-bc27-2384c5a5220c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:22.328932 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4249efac-ba82-4055-bc27-2384c5a5220c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:22.334617 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4249efac-ba82-4055-bc27-2384c5a5220c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:22.335084 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4249efac-ba82-4055-bc27-2384c5a5220c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:22.335857 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4249efac-ba82-4055-bc27-2384c5a5220c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:22.336287 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4249efac-ba82-4055-bc27-2384c5a5220c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:22.337975 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-31e04c51-71ed-44d5-90a5-fab9b4aeb259 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:22.345204 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-31e04c51-71ed-44d5-90a5-fab9b4aeb259 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152908 Jul 19 09:30:22.345774 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 357/689] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:22 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:22.470546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4249efac-ba82-4055-bc27-2384c5a5220c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:22.478621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4249efac-ba82-4055-bc27-2384c5a5220c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:22.480150 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4249efac-ba82-4055-bc27-2384c5a5220c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:22.481340 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4249efac-ba82-4055-bc27-2384c5a5220c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.157272 Jul 19 09:30:22.481893 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 333/690] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:22 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:30:23.362485 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-60c25708-ba48-4937-ba7a-22684005ba33 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:23.363149 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-60c25708-ba48-4937-ba7a-22684005ba33 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:23.368996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-60c25708-ba48-4937-ba7a-22684005ba33 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:23.369449 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-60c25708-ba48-4937-ba7a-22684005ba33 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:23.370214 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-60c25708-ba48-4937-ba7a-22684005ba33 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:23.370649 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-60c25708-ba48-4937-ba7a-22684005ba33 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:23.500649 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-24dda191-fdde-460a-afb9-1d911fa437c7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:23.501375 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-24dda191-fdde-460a-afb9-1d911fa437c7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:23.507143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-24dda191-fdde-460a-afb9-1d911fa437c7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:23.507797 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-24dda191-fdde-460a-afb9-1d911fa437c7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:23.507929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-60c25708-ba48-4937-ba7a-22684005ba33 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:23.508613 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-24dda191-fdde-460a-afb9-1d911fa437c7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:23.509051 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-24dda191-fdde-460a-afb9-1d911fa437c7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:23.517154 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-60c25708-ba48-4937-ba7a-22684005ba33 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.158312 Jul 19 09:30:23.518678 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 358/691] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:23 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:23.647235 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-24dda191-fdde-460a-afb9-1d911fa437c7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:23.655985 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-24dda191-fdde-460a-afb9-1d911fa437c7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:23.657497 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-24dda191-fdde-460a-afb9-1d911fa437c7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:23.658848 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-24dda191-fdde-460a-afb9-1d911fa437c7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.162985 Jul 19 09:30:23.659445 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 334/692] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:23 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:30:24.534958 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cb1e7bb2-1634-4d41-b38c-9b4e632ee8d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:24.535605 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-cb1e7bb2-1634-4d41-b38c-9b4e632ee8d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:24.541610 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cb1e7bb2-1634-4d41-b38c-9b4e632ee8d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:24.542065 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cb1e7bb2-1634-4d41-b38c-9b4e632ee8d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:24.542825 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cb1e7bb2-1634-4d41-b38c-9b4e632ee8d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:24.543289 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cb1e7bb2-1634-4d41-b38c-9b4e632ee8d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:24.678183 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-98135ba8-c1fd-48bc-a85b-b3eaafefebb9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:24.678909 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-98135ba8-c1fd-48bc-a85b-b3eaafefebb9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:24.679022 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cb1e7bb2-1634-4d41-b38c-9b4e632ee8d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:24.686686 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98135ba8-c1fd-48bc-a85b-b3eaafefebb9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:24.686870 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-cb1e7bb2-1634-4d41-b38c-9b4e632ee8d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.155343 Jul 19 09:30:24.687251 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98135ba8-c1fd-48bc-a85b-b3eaafefebb9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:24.687395 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 359/693] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:24 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:24.688452 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98135ba8-c1fd-48bc-a85b-b3eaafefebb9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:24.688970 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98135ba8-c1fd-48bc-a85b-b3eaafefebb9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:24.821845 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-98135ba8-c1fd-48bc-a85b-b3eaafefebb9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:24.830556 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-98135ba8-c1fd-48bc-a85b-b3eaafefebb9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:24.832089 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-98135ba8-c1fd-48bc-a85b-b3eaafefebb9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:24.833222 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-98135ba8-c1fd-48bc-a85b-b3eaafefebb9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.159151 Jul 19 09:30:24.833775 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 335/694] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:24 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:30:25.703707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-98f066c8-d98e-49d8-913f-8cd5255f52b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:25.704310 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-98f066c8-d98e-49d8-913f-8cd5255f52b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:25.710197 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-98f066c8-d98e-49d8-913f-8cd5255f52b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:25.710651 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-98f066c8-d98e-49d8-913f-8cd5255f52b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:25.711492 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-98f066c8-d98e-49d8-913f-8cd5255f52b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:25.711929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-98f066c8-d98e-49d8-913f-8cd5255f52b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:25.844373 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-98f066c8-d98e-49d8-913f-8cd5255f52b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:25.851023 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bae84321-10fe-44d6-b474-ab3cd8ac9835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:25.851654 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bae84321-10fe-44d6-b474-ab3cd8ac9835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:25.851794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-98f066c8-d98e-49d8-913f-8cd5255f52b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152224 Jul 19 09:30:25.852225 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 360/695] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:25 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:25.857833 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bae84321-10fe-44d6-b474-ab3cd8ac9835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:25.858279 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bae84321-10fe-44d6-b474-ab3cd8ac9835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:25.859058 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bae84321-10fe-44d6-b474-ab3cd8ac9835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:25.859499 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bae84321-10fe-44d6-b474-ab3cd8ac9835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:25.992557 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bae84321-10fe-44d6-b474-ab3cd8ac9835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:26.001285 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bae84321-10fe-44d6-b474-ab3cd8ac9835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:26.002784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bae84321-10fe-44d6-b474-ab3cd8ac9835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:26.003944 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bae84321-10fe-44d6-b474-ab3cd8ac9835 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.156563 Jul 19 09:30:26.004502 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 336/696] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:25 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:26.868686 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8bb1bdb1-3dd2-4919-a91c-9c434000123f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:26.869299 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8bb1bdb1-3dd2-4919-a91c-9c434000123f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:26.875328 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8bb1bdb1-3dd2-4919-a91c-9c434000123f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:26.875818 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8bb1bdb1-3dd2-4919-a91c-9c434000123f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:26.876594 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8bb1bdb1-3dd2-4919-a91c-9c434000123f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:26.877032 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8bb1bdb1-3dd2-4919-a91c-9c434000123f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:27.009845 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8bb1bdb1-3dd2-4919-a91c-9c434000123f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:27.017218 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8bb1bdb1-3dd2-4919-a91c-9c434000123f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152174 Jul 19 09:30:27.017779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 361/697] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:26 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:27.021465 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b210e638-a2bd-4124-b4bd-1b2b6db61207 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:27.022090 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b210e638-a2bd-4124-b4bd-1b2b6db61207 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:27.028771 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b210e638-a2bd-4124-b4bd-1b2b6db61207 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:27.029268 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b210e638-a2bd-4124-b4bd-1b2b6db61207 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:27.030139 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b210e638-a2bd-4124-b4bd-1b2b6db61207 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:27.030603 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b210e638-a2bd-4124-b4bd-1b2b6db61207 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:27.162519 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b210e638-a2bd-4124-b4bd-1b2b6db61207 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:27.171632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b210e638-a2bd-4124-b4bd-1b2b6db61207 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:27.173149 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b210e638-a2bd-4124-b4bd-1b2b6db61207 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:27.174286 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b210e638-a2bd-4124-b4bd-1b2b6db61207 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.156585 Jul 19 09:30:27.174846 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 337/698] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:27 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:30:28.033344 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1c795183-e837-4bc0-8c15-08ad6a2b6c17 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:28.033948 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1c795183-e837-4bc0-8c15-08ad6a2b6c17 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:28.039837 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c795183-e837-4bc0-8c15-08ad6a2b6c17 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:28.040290 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c795183-e837-4bc0-8c15-08ad6a2b6c17 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:28.041320 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c795183-e837-4bc0-8c15-08ad6a2b6c17 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:28.041808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c795183-e837-4bc0-8c15-08ad6a2b6c17 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:28.178830 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1c795183-e837-4bc0-8c15-08ad6a2b6c17 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:28.186888 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1c795183-e837-4bc0-8c15-08ad6a2b6c17 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.157067 Jul 19 09:30:28.187724 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 362/699] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:28 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:28.192322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d0592b87-922d-462a-9c4c-bbf2a053ba37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:28.192926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d0592b87-922d-462a-9c4c-bbf2a053ba37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:28.198721 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d0592b87-922d-462a-9c4c-bbf2a053ba37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:28.199216 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d0592b87-922d-462a-9c4c-bbf2a053ba37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:28.200008 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d0592b87-922d-462a-9c4c-bbf2a053ba37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:28.200433 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d0592b87-922d-462a-9c4c-bbf2a053ba37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:28.592233 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d0592b87-922d-462a-9c4c-bbf2a053ba37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:28.600435 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d0592b87-922d-462a-9c4c-bbf2a053ba37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:28.601926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d0592b87-922d-462a-9c4c-bbf2a053ba37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:28.603096 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d0592b87-922d-462a-9c4c-bbf2a053ba37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.414514 Jul 19 09:30:28.603642 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 338/700] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:28 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:30:29.203103 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d447db1e-5c72-4150-9b3f-3a03f822a3bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:29.203676 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d447db1e-5c72-4150-9b3f-3a03f822a3bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:29.209716 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d447db1e-5c72-4150-9b3f-3a03f822a3bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:29.210258 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d447db1e-5c72-4150-9b3f-3a03f822a3bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:29.211102 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d447db1e-5c72-4150-9b3f-3a03f822a3bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:29.211577 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d447db1e-5c72-4150-9b3f-3a03f822a3bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:29.346806 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d447db1e-5c72-4150-9b3f-3a03f822a3bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:29.354551 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d447db1e-5c72-4150-9b3f-3a03f822a3bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.155139 Jul 19 09:30:29.355178 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 363/701] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:29 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:29.622340 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cb0d5fd8-ccc4-46b7-ad5d-5c5e1f0a0dda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:29.622973 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cb0d5fd8-ccc4-46b7-ad5d-5c5e1f0a0dda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:29.628943 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cb0d5fd8-ccc4-46b7-ad5d-5c5e1f0a0dda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:29.629413 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cb0d5fd8-ccc4-46b7-ad5d-5c5e1f0a0dda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:29.630183 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cb0d5fd8-ccc4-46b7-ad5d-5c5e1f0a0dda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:29.630621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cb0d5fd8-ccc4-46b7-ad5d-5c5e1f0a0dda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:29.765299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cb0d5fd8-ccc4-46b7-ad5d-5c5e1f0a0dda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:29.774511 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cb0d5fd8-ccc4-46b7-ad5d-5c5e1f0a0dda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:29.776059 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cb0d5fd8-ccc4-46b7-ad5d-5c5e1f0a0dda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:29.777139 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cb0d5fd8-ccc4-46b7-ad5d-5c5e1f0a0dda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.159180 Jul 19 09:30:29.777727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 339/702] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:29 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:30.371182 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ffe4c6a8-9f0c-450e-b47c-3132850a6ba5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:30.371758 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ffe4c6a8-9f0c-450e-b47c-3132850a6ba5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:30.377945 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ffe4c6a8-9f0c-450e-b47c-3132850a6ba5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:30.378400 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ffe4c6a8-9f0c-450e-b47c-3132850a6ba5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:30.379221 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ffe4c6a8-9f0c-450e-b47c-3132850a6ba5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:30.379667 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ffe4c6a8-9f0c-450e-b47c-3132850a6ba5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:30.518608 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ffe4c6a8-9f0c-450e-b47c-3132850a6ba5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:30.526357 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ffe4c6a8-9f0c-450e-b47c-3132850a6ba5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.158909 Jul 19 09:30:30.526923 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 364/703] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:30 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:30.796026 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9902af48-f918-4051-a8ef-38477fc8f3d8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:30.796621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9902af48-f918-4051-a8ef-38477fc8f3d8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:30.803021 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9902af48-f918-4051-a8ef-38477fc8f3d8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:30.803522 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9902af48-f918-4051-a8ef-38477fc8f3d8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:30.804292 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9902af48-f918-4051-a8ef-38477fc8f3d8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:30.804722 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9902af48-f918-4051-a8ef-38477fc8f3d8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:30.948169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9902af48-f918-4051-a8ef-38477fc8f3d8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:30.958149 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9902af48-f918-4051-a8ef-38477fc8f3d8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:30.959702 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9902af48-f918-4051-a8ef-38477fc8f3d8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:30.961057 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9902af48-f918-4051-a8ef-38477fc8f3d8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.168827 Jul 19 09:30:30.961606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 340/704] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:30 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:31.544726 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f991955c-0f23-457a-9611-197695061e6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:31.546807 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f991955c-0f23-457a-9611-197695061e6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:31.551367 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f991955c-0f23-457a-9611-197695061e6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:31.551825 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f991955c-0f23-457a-9611-197695061e6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:31.552605 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f991955c-0f23-457a-9611-197695061e6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:31.553043 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f991955c-0f23-457a-9611-197695061e6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:31.687952 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f991955c-0f23-457a-9611-197695061e6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:31.695207 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f991955c-0f23-457a-9611-197695061e6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.154575 Jul 19 09:30:31.695978 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 365/705] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:31 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:31.979303 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-540570bb-9843-473e-bd91-60b8f23238d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:31.980099 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-540570bb-9843-473e-bd91-60b8f23238d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:31.986858 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-540570bb-9843-473e-bd91-60b8f23238d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:31.987353 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-540570bb-9843-473e-bd91-60b8f23238d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:31.988165 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-540570bb-9843-473e-bd91-60b8f23238d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:31.988605 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-540570bb-9843-473e-bd91-60b8f23238d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:32.125816 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-540570bb-9843-473e-bd91-60b8f23238d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:32.134205 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-540570bb-9843-473e-bd91-60b8f23238d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:32.135733 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-540570bb-9843-473e-bd91-60b8f23238d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:32.136880 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-540570bb-9843-473e-bd91-60b8f23238d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.161267 Jul 19 09:30:32.138001 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 341/706] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:31 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:30:32.713536 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-abdb73c6-e7ea-468f-8e07-5261fababb64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:32.714144 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-abdb73c6-e7ea-468f-8e07-5261fababb64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:32.720281 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-abdb73c6-e7ea-468f-8e07-5261fababb64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:32.720748 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-abdb73c6-e7ea-468f-8e07-5261fababb64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:32.721506 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-abdb73c6-e7ea-468f-8e07-5261fababb64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:32.721942 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-abdb73c6-e7ea-468f-8e07-5261fababb64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:32.785300 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:30:32.785300 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:30:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 (ip 10.222.0.16) !!! Jul 19 09:30:32.860760 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-abdb73c6-e7ea-468f-8e07-5261fababb64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:32.868292 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-abdb73c6-e7ea-468f-8e07-5261fababb64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.158380 Jul 19 09:30:32.868846 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 366/707] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:32 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:33.157509 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9cb887d5-ad36-45e9-8765-e74a2089d67b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:33.158045 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9cb887d5-ad36-45e9-8765-e74a2089d67b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:33.170984 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9cb887d5-ad36-45e9-8765-e74a2089d67b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:33.171484 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9cb887d5-ad36-45e9-8765-e74a2089d67b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:33.172261 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9cb887d5-ad36-45e9-8765-e74a2089d67b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:33.172886 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9cb887d5-ad36-45e9-8765-e74a2089d67b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:33.334042 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-cce5faef-9f70-4da6-b74b-d54d64b6cebf req-ef37e2de-1867-456d-afff-0c06000a67d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee02e36e-7587-4ab3-b367-08e1c9b26c69", "name": "network-vif-unplugged", "status": "completed", "tag": "8c6fc9b0-949b-4965-80e0-e84ca522d2a6"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:30:33.337858 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:30:33.337858 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:30:33.347110 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-cce5faef-9f70-4da6-b74b-d54d64b6cebf req-ef37e2de-1867-456d-afff-0c06000a67d5 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:33.350300 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-cce5faef-9f70-4da6-b74b-d54d64b6cebf req-ef37e2de-1867-456d-afff-0c06000a67d5 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:33.364547 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-cce5faef-9f70-4da6-b74b-d54d64b6cebf req-ef37e2de-1867-456d-afff-0c06000a67d5 service nova] Creating event network-vif-unplugged:8c6fc9b0-949b-4965-80e0-e84ca522d2a6 for instance ee02e36e-7587-4ab3-b367-08e1c9b26c69 on hv-cinder-79338 Jul 19 09:30:33.371445 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-cce5faef-9f70-4da6-b74b-d54d64b6cebf req-ef37e2de-1867-456d-afff-0c06000a67d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041368 Jul 19 09:30:33.372872 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 367/708] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:30:33 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:30:33.382229 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9cb887d5-ad36-45e9-8765-e74a2089d67b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:33.396796 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9cb887d5-ad36-45e9-8765-e74a2089d67b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:33.398545 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9cb887d5-ad36-45e9-8765-e74a2089d67b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:33.400061 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9cb887d5-ad36-45e9-8765-e74a2089d67b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.246590 Jul 19 09:30:33.400981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 342/709] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:33 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:30:33.884932 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3e228cb5-de3d-43d1-bdbf-ae712592ef8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:33.885790 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3e228cb5-de3d-43d1-bdbf-ae712592ef8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:33.892295 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3e228cb5-de3d-43d1-bdbf-ae712592ef8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:33.892744 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3e228cb5-de3d-43d1-bdbf-ae712592ef8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:33.893511 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3e228cb5-de3d-43d1-bdbf-ae712592ef8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:33.893943 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3e228cb5-de3d-43d1-bdbf-ae712592ef8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:34.033430 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3e228cb5-de3d-43d1-bdbf-ae712592ef8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:34.041166 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3e228cb5-de3d-43d1-bdbf-ae712592ef8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.160024 Jul 19 09:30:34.041738 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 368/710] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:33 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:34.516391 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8d1ebaf4-e2fd-42ff-aa2a-f5205dcb69af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:34.517009 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8d1ebaf4-e2fd-42ff-aa2a-f5205dcb69af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:34.523014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8d1ebaf4-e2fd-42ff-aa2a-f5205dcb69af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:34.523555 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8d1ebaf4-e2fd-42ff-aa2a-f5205dcb69af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:34.524352 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8d1ebaf4-e2fd-42ff-aa2a-f5205dcb69af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:34.524785 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8d1ebaf4-e2fd-42ff-aa2a-f5205dcb69af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:34.660783 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8d1ebaf4-e2fd-42ff-aa2a-f5205dcb69af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:34.670040 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8d1ebaf4-e2fd-42ff-aa2a-f5205dcb69af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:34.671575 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8d1ebaf4-e2fd-42ff-aa2a-f5205dcb69af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:34.673107 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8d1ebaf4-e2fd-42ff-aa2a-f5205dcb69af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.259101 Jul 19 09:30:34.673687 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 343/711] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:34 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:35.059217 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0875f77b-30c0-4cf9-ae16-01ba8793f883 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:35.059795 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0875f77b-30c0-4cf9-ae16-01ba8793f883 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:35.065664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0875f77b-30c0-4cf9-ae16-01ba8793f883 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:35.066115 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0875f77b-30c0-4cf9-ae16-01ba8793f883 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:35.066867 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0875f77b-30c0-4cf9-ae16-01ba8793f883 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:35.067381 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0875f77b-30c0-4cf9-ae16-01ba8793f883 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:35.206113 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0875f77b-30c0-4cf9-ae16-01ba8793f883 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:35.213411 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0875f77b-30c0-4cf9-ae16-01ba8793f883 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.158469 Jul 19 09:30:35.213969 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 369/712] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:35 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:35.691526 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8093dde7-349e-46e2-ab7e-3a10e204b4ac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:35.692052 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8093dde7-349e-46e2-ab7e-3a10e204b4ac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:35.698633 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8093dde7-349e-46e2-ab7e-3a10e204b4ac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:35.699101 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8093dde7-349e-46e2-ab7e-3a10e204b4ac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:35.700453 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8093dde7-349e-46e2-ab7e-3a10e204b4ac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:35.700920 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8093dde7-349e-46e2-ab7e-3a10e204b4ac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:35.836399 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8093dde7-349e-46e2-ab7e-3a10e204b4ac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:35.844501 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8093dde7-349e-46e2-ab7e-3a10e204b4ac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:35.846007 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8093dde7-349e-46e2-ab7e-3a10e204b4ac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:35.847156 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8093dde7-349e-46e2-ab7e-3a10e204b4ac tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.159429 Jul 19 09:30:35.847710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 344/713] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:35 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:36.231070 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-78a7d99f-5cfd-446e-a2d5-086f8206da73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:36.231728 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-78a7d99f-5cfd-446e-a2d5-086f8206da73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:36.237675 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-78a7d99f-5cfd-446e-a2d5-086f8206da73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:36.238127 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-78a7d99f-5cfd-446e-a2d5-086f8206da73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:36.238927 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-78a7d99f-5cfd-446e-a2d5-086f8206da73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:36.239375 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-78a7d99f-5cfd-446e-a2d5-086f8206da73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:36.373467 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-78a7d99f-5cfd-446e-a2d5-086f8206da73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:36.380757 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-78a7d99f-5cfd-446e-a2d5-086f8206da73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.154006 Jul 19 09:30:36.381325 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 370/714] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:36 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:36.864925 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b0fd60e1-7403-4f35-beb2-c55d799e8428 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:36.865534 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b0fd60e1-7403-4f35-beb2-c55d799e8428 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:36.871861 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b0fd60e1-7403-4f35-beb2-c55d799e8428 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:36.872303 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b0fd60e1-7403-4f35-beb2-c55d799e8428 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:36.873056 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b0fd60e1-7403-4f35-beb2-c55d799e8428 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:36.873485 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b0fd60e1-7403-4f35-beb2-c55d799e8428 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:37.007738 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b0fd60e1-7403-4f35-beb2-c55d799e8428 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:37.015908 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b0fd60e1-7403-4f35-beb2-c55d799e8428 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:37.017419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b0fd60e1-7403-4f35-beb2-c55d799e8428 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:37.018553 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b0fd60e1-7403-4f35-beb2-c55d799e8428 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.157317 Jul 19 09:30:37.019124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 345/715] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:36 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:37.149672 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:30:37.149841 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:30:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:30:37.398029 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-277f68ea-268b-41a1-aad0-f4ad4ced7012 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:37.398651 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-277f68ea-268b-41a1-aad0-f4ad4ced7012 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:37.405063 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-277f68ea-268b-41a1-aad0-f4ad4ced7012 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:37.405459 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-277f68ea-268b-41a1-aad0-f4ad4ced7012 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:37.406215 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-277f68ea-268b-41a1-aad0-f4ad4ced7012 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:37.406644 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-277f68ea-268b-41a1-aad0-f4ad4ced7012 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:37.539779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-277f68ea-268b-41a1-aad0-f4ad4ced7012 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:37.548265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-277f68ea-268b-41a1-aad0-f4ad4ced7012 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.153936 Jul 19 09:30:37.548842 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 371/716] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:37 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:38.035994 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fa8153fa-0e5e-4916-8bc9-a7bf49a9cfc9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:38.036708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fa8153fa-0e5e-4916-8bc9-a7bf49a9cfc9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:38.042701 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa8153fa-0e5e-4916-8bc9-a7bf49a9cfc9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:38.043670 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa8153fa-0e5e-4916-8bc9-a7bf49a9cfc9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:38.044440 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa8153fa-0e5e-4916-8bc9-a7bf49a9cfc9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:38.044878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa8153fa-0e5e-4916-8bc9-a7bf49a9cfc9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:38.177590 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fa8153fa-0e5e-4916-8bc9-a7bf49a9cfc9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:38.186042 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fa8153fa-0e5e-4916-8bc9-a7bf49a9cfc9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:38.187583 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fa8153fa-0e5e-4916-8bc9-a7bf49a9cfc9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:38.189080 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fa8153fa-0e5e-4916-8bc9-a7bf49a9cfc9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.156832 Jul 19 09:30:38.189647 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 346/717] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:38 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:30:38.564781 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3822d1ee-6773-47a4-9d3d-1520d96852b4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:38.565382 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3822d1ee-6773-47a4-9d3d-1520d96852b4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:38.571173 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3822d1ee-6773-47a4-9d3d-1520d96852b4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:38.571614 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3822d1ee-6773-47a4-9d3d-1520d96852b4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:38.572362 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3822d1ee-6773-47a4-9d3d-1520d96852b4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:38.572788 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3822d1ee-6773-47a4-9d3d-1520d96852b4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:38.701526 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3822d1ee-6773-47a4-9d3d-1520d96852b4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:38.708734 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3822d1ee-6773-47a4-9d3d-1520d96852b4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.147583 Jul 19 09:30:38.709296 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 372/718] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:38 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:39.207107 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-88aca752-371b-413e-9a8c-3bfd9119a0d1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:39.207678 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-88aca752-371b-413e-9a8c-3bfd9119a0d1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:39.213651 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-88aca752-371b-413e-9a8c-3bfd9119a0d1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:39.214103 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-88aca752-371b-413e-9a8c-3bfd9119a0d1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:39.214901 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-88aca752-371b-413e-9a8c-3bfd9119a0d1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:39.215376 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-88aca752-371b-413e-9a8c-3bfd9119a0d1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:39.349102 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-88aca752-371b-413e-9a8c-3bfd9119a0d1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:39.357884 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-88aca752-371b-413e-9a8c-3bfd9119a0d1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:39.359459 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-88aca752-371b-413e-9a8c-3bfd9119a0d1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:39.360602 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-88aca752-371b-413e-9a8c-3bfd9119a0d1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.157340 Jul 19 09:30:39.361161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 347/719] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:39 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:39.725738 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5b2b1d35-25c4-4a4d-9ad6-540b54a9dcbb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:39.726338 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5b2b1d35-25c4-4a4d-9ad6-540b54a9dcbb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:39.732048 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5b2b1d35-25c4-4a4d-9ad6-540b54a9dcbb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:39.732489 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5b2b1d35-25c4-4a4d-9ad6-540b54a9dcbb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:39.733313 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5b2b1d35-25c4-4a4d-9ad6-540b54a9dcbb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:39.733777 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5b2b1d35-25c4-4a4d-9ad6-540b54a9dcbb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:39.865734 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5b2b1d35-25c4-4a4d-9ad6-540b54a9dcbb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:39.873792 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5b2b1d35-25c4-4a4d-9ad6-540b54a9dcbb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.151651 Jul 19 09:30:39.874382 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 373/720] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:39 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:40.378676 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bf22e814-f349-428f-aced-076313cb56e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:40.379212 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bf22e814-f349-428f-aced-076313cb56e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:40.384982 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf22e814-f349-428f-aced-076313cb56e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:40.385426 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf22e814-f349-428f-aced-076313cb56e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:40.386179 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf22e814-f349-428f-aced-076313cb56e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:40.386615 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bf22e814-f349-428f-aced-076313cb56e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:40.516678 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bf22e814-f349-428f-aced-076313cb56e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:40.524748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bf22e814-f349-428f-aced-076313cb56e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:40.526245 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bf22e814-f349-428f-aced-076313cb56e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:40.527422 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bf22e814-f349-428f-aced-076313cb56e7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152493 Jul 19 09:30:40.527964 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 348/721] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:40 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:40.890620 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-acb4a600-99fa-48f1-adb7-c64619fc8a40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:40.891254 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-acb4a600-99fa-48f1-adb7-c64619fc8a40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:40.896977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-acb4a600-99fa-48f1-adb7-c64619fc8a40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:40.897421 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-acb4a600-99fa-48f1-adb7-c64619fc8a40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:40.898176 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-acb4a600-99fa-48f1-adb7-c64619fc8a40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:40.898606 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-acb4a600-99fa-48f1-adb7-c64619fc8a40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:41.034741 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-acb4a600-99fa-48f1-adb7-c64619fc8a40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:41.042401 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-acb4a600-99fa-48f1-adb7-c64619fc8a40 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.155437 Jul 19 09:30:41.042977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 374/722] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:40 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:41.546392 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a728922d-3161-4e27-918e-720d88f86925 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:41.546929 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a728922d-3161-4e27-918e-720d88f86925 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:41.552744 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a728922d-3161-4e27-918e-720d88f86925 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:41.553190 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a728922d-3161-4e27-918e-720d88f86925 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:41.553945 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a728922d-3161-4e27-918e-720d88f86925 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:41.554376 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a728922d-3161-4e27-918e-720d88f86925 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:41.686530 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a728922d-3161-4e27-918e-720d88f86925 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:41.694602 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a728922d-3161-4e27-918e-720d88f86925 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:41.696129 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a728922d-3161-4e27-918e-720d88f86925 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:41.697262 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a728922d-3161-4e27-918e-720d88f86925 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155146 Jul 19 09:30:41.697823 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 349/723] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:41 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:42.059234 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-43d51c20-9943-43c7-ba21-99e4023e3df4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:42.059825 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-43d51c20-9943-43c7-ba21-99e4023e3df4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:42.065547 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-43d51c20-9943-43c7-ba21-99e4023e3df4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:42.065989 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-43d51c20-9943-43c7-ba21-99e4023e3df4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:42.066740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-43d51c20-9943-43c7-ba21-99e4023e3df4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:42.067196 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-43d51c20-9943-43c7-ba21-99e4023e3df4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:42.200418 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-43d51c20-9943-43c7-ba21-99e4023e3df4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:42.207779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-43d51c20-9943-43c7-ba21-99e4023e3df4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152248 Jul 19 09:30:42.208338 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 375/724] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:42 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:42.715637 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f3a561fb-195d-4876-8cc8-43e06752f224 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:42.716228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f3a561fb-195d-4876-8cc8-43e06752f224 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:42.721931 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f3a561fb-195d-4876-8cc8-43e06752f224 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:42.722372 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f3a561fb-195d-4876-8cc8-43e06752f224 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:42.723153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f3a561fb-195d-4876-8cc8-43e06752f224 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:42.723582 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f3a561fb-195d-4876-8cc8-43e06752f224 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:42.858741 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f3a561fb-195d-4876-8cc8-43e06752f224 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:42.866832 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f3a561fb-195d-4876-8cc8-43e06752f224 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:42.868366 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f3a561fb-195d-4876-8cc8-43e06752f224 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:42.869487 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f3a561fb-195d-4876-8cc8-43e06752f224 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.158066 Jul 19 09:30:42.870040 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 350/725] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:42 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:30:43.224311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f4f71d26-c873-4c86-9852-711fd48197e3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:43.224914 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f4f71d26-c873-4c86-9852-711fd48197e3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:43.230688 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4f71d26-c873-4c86-9852-711fd48197e3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:43.231164 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4f71d26-c873-4c86-9852-711fd48197e3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:43.231921 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4f71d26-c873-4c86-9852-711fd48197e3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:43.232354 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4f71d26-c873-4c86-9852-711fd48197e3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:43.359969 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f4f71d26-c873-4c86-9852-711fd48197e3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:43.367276 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f4f71d26-c873-4c86-9852-711fd48197e3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.146567 Jul 19 09:30:43.367847 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 376/726] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:43 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:43.887392 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-076765be-5218-4517-8477-bd59f0a7a9e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:43.887998 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-076765be-5218-4517-8477-bd59f0a7a9e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:43.893937 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-076765be-5218-4517-8477-bd59f0a7a9e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:43.894377 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-076765be-5218-4517-8477-bd59f0a7a9e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:43.895157 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-076765be-5218-4517-8477-bd59f0a7a9e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:43.895589 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-076765be-5218-4517-8477-bd59f0a7a9e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:44.028664 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-076765be-5218-4517-8477-bd59f0a7a9e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:44.036748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-076765be-5218-4517-8477-bd59f0a7a9e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:44.038256 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-076765be-5218-4517-8477-bd59f0a7a9e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:44.039409 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-076765be-5218-4517-8477-bd59f0a7a9e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155947 Jul 19 09:30:44.039966 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 351/727] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:43 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:44.384414 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-69b97e27-4069-4deb-b0f7-759fb6809937 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:44.385028 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-69b97e27-4069-4deb-b0f7-759fb6809937 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:44.391423 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69b97e27-4069-4deb-b0f7-759fb6809937 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:44.391878 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69b97e27-4069-4deb-b0f7-759fb6809937 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:44.392642 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69b97e27-4069-4deb-b0f7-759fb6809937 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:44.393077 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69b97e27-4069-4deb-b0f7-759fb6809937 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:44.520952 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-69b97e27-4069-4deb-b0f7-759fb6809937 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:44.528273 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-69b97e27-4069-4deb-b0f7-759fb6809937 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.147522 Jul 19 09:30:44.528846 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 377/728] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:44 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:45.057536 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2ee2e1fe-053c-4387-b3a1-2115e5a05174 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:45.058139 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2ee2e1fe-053c-4387-b3a1-2115e5a05174 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:45.064107 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2ee2e1fe-053c-4387-b3a1-2115e5a05174 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:45.064553 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2ee2e1fe-053c-4387-b3a1-2115e5a05174 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:45.065314 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2ee2e1fe-053c-4387-b3a1-2115e5a05174 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:45.065748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2ee2e1fe-053c-4387-b3a1-2115e5a05174 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:45.200839 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2ee2e1fe-053c-4387-b3a1-2115e5a05174 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:45.209677 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2ee2e1fe-053c-4387-b3a1-2115e5a05174 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:45.211292 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2ee2e1fe-053c-4387-b3a1-2115e5a05174 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:45.212473 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2ee2e1fe-053c-4387-b3a1-2115e5a05174 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.158662 Jul 19 09:30:45.213026 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 352/729] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:45 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:45.544312 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6622b542-817c-4e77-ad55-fcc35ffcfe9b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:45.544915 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6622b542-817c-4e77-ad55-fcc35ffcfe9b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:45.550744 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6622b542-817c-4e77-ad55-fcc35ffcfe9b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:45.551229 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6622b542-817c-4e77-ad55-fcc35ffcfe9b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:45.551986 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6622b542-817c-4e77-ad55-fcc35ffcfe9b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:45.552413 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6622b542-817c-4e77-ad55-fcc35ffcfe9b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:45.683814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6622b542-817c-4e77-ad55-fcc35ffcfe9b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:45.690974 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6622b542-817c-4e77-ad55-fcc35ffcfe9b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.150553 Jul 19 09:30:45.691571 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 378/730] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:45 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:46.231441 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4e5fc19d-4eec-4cb4-bfac-dcf0a68fd4c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:46.232049 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4e5fc19d-4eec-4cb4-bfac-dcf0a68fd4c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:46.237901 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4e5fc19d-4eec-4cb4-bfac-dcf0a68fd4c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:46.238522 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4e5fc19d-4eec-4cb4-bfac-dcf0a68fd4c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:46.239312 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4e5fc19d-4eec-4cb4-bfac-dcf0a68fd4c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:46.239742 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4e5fc19d-4eec-4cb4-bfac-dcf0a68fd4c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:46.370411 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4e5fc19d-4eec-4cb4-bfac-dcf0a68fd4c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:46.378532 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4e5fc19d-4eec-4cb4-bfac-dcf0a68fd4c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:46.380057 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4e5fc19d-4eec-4cb4-bfac-dcf0a68fd4c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:46.381181 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4e5fc19d-4eec-4cb4-bfac-dcf0a68fd4c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.154084 Jul 19 09:30:46.381735 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 353/731] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:46 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:46.707937 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3968548f-fa3e-4a9b-baba-68aea91a3158 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:46.708533 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3968548f-fa3e-4a9b-baba-68aea91a3158 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:46.714263 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3968548f-fa3e-4a9b-baba-68aea91a3158 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:46.715293 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3968548f-fa3e-4a9b-baba-68aea91a3158 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:46.716044 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3968548f-fa3e-4a9b-baba-68aea91a3158 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:46.716470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3968548f-fa3e-4a9b-baba-68aea91a3158 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:46.847202 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3968548f-fa3e-4a9b-baba-68aea91a3158 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:46.854503 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3968548f-fa3e-4a9b-baba-68aea91a3158 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.150189 Jul 19 09:30:46.855100 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 379/732] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:46 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:47.398524 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b4ac0ab5-d8c1-492c-a4a3-455b0eed72dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:47.399152 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b4ac0ab5-d8c1-492c-a4a3-455b0eed72dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:47.405004 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b4ac0ab5-d8c1-492c-a4a3-455b0eed72dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:47.405450 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b4ac0ab5-d8c1-492c-a4a3-455b0eed72dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:47.406211 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b4ac0ab5-d8c1-492c-a4a3-455b0eed72dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:47.406643 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b4ac0ab5-d8c1-492c-a4a3-455b0eed72dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:47.535712 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b4ac0ab5-d8c1-492c-a4a3-455b0eed72dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:47.544466 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b4ac0ab5-d8c1-492c-a4a3-455b0eed72dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:47.545991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b4ac0ab5-d8c1-492c-a4a3-455b0eed72dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:47.547133 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b4ac0ab5-d8c1-492c-a4a3-455b0eed72dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152338 Jul 19 09:30:47.547680 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 354/733] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:47 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:47.871177 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-076e42dc-5537-4cee-bbb7-06de991a5a52 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:47.871729 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-076e42dc-5537-4cee-bbb7-06de991a5a52 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:47.877429 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-076e42dc-5537-4cee-bbb7-06de991a5a52 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:47.877879 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-076e42dc-5537-4cee-bbb7-06de991a5a52 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:47.878633 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-076e42dc-5537-4cee-bbb7-06de991a5a52 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:47.879083 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-076e42dc-5537-4cee-bbb7-06de991a5a52 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:48.012117 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-076e42dc-5537-4cee-bbb7-06de991a5a52 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:48.019339 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-076e42dc-5537-4cee-bbb7-06de991a5a52 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.151939 Jul 19 09:30:48.019906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 380/734] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:47 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:48.565003 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7050157d-0144-40c3-a40c-02a33049000d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:48.565566 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7050157d-0144-40c3-a40c-02a33049000d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:48.571379 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7050157d-0144-40c3-a40c-02a33049000d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:48.571833 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7050157d-0144-40c3-a40c-02a33049000d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:48.572602 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7050157d-0144-40c3-a40c-02a33049000d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:48.573040 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7050157d-0144-40c3-a40c-02a33049000d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:48.704182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7050157d-0144-40c3-a40c-02a33049000d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:48.712201 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7050157d-0144-40c3-a40c-02a33049000d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:48.713688 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7050157d-0144-40c3-a40c-02a33049000d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:48.715344 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7050157d-0144-40c3-a40c-02a33049000d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.154079 Jul 19 09:30:48.715904 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 355/735] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:48 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:49.035496 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7c4695b6-3d22-4f56-9d1c-c93241e39b63 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:49.036103 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7c4695b6-3d22-4f56-9d1c-c93241e39b63 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:49.042119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7c4695b6-3d22-4f56-9d1c-c93241e39b63 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:49.042614 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7c4695b6-3d22-4f56-9d1c-c93241e39b63 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:49.043413 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7c4695b6-3d22-4f56-9d1c-c93241e39b63 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:49.043853 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7c4695b6-3d22-4f56-9d1c-c93241e39b63 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:49.172311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7c4695b6-3d22-4f56-9d1c-c93241e39b63 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:49.179653 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7c4695b6-3d22-4f56-9d1c-c93241e39b63 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.147798 Jul 19 09:30:49.180229 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 381/736] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:49 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:49.733129 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-50e17948-9420-47c1-95e1-8d1449994889 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:49.733768 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-50e17948-9420-47c1-95e1-8d1449994889 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:49.739566 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50e17948-9420-47c1-95e1-8d1449994889 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:49.740009 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50e17948-9420-47c1-95e1-8d1449994889 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:49.740794 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50e17948-9420-47c1-95e1-8d1449994889 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:49.741233 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50e17948-9420-47c1-95e1-8d1449994889 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:49.870932 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-50e17948-9420-47c1-95e1-8d1449994889 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:49.879005 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-50e17948-9420-47c1-95e1-8d1449994889 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:49.880548 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-50e17948-9420-47c1-95e1-8d1449994889 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:49.881688 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-50e17948-9420-47c1-95e1-8d1449994889 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152274 Jul 19 09:30:49.882253 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 356/737] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:49 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:50.196221 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-848c1f69-3c70-4dcc-83a9-39f9c2587bcd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:50.196823 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-848c1f69-3c70-4dcc-83a9-39f9c2587bcd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:50.203147 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-848c1f69-3c70-4dcc-83a9-39f9c2587bcd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:50.203590 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-848c1f69-3c70-4dcc-83a9-39f9c2587bcd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:50.204340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-848c1f69-3c70-4dcc-83a9-39f9c2587bcd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:50.204763 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-848c1f69-3c70-4dcc-83a9-39f9c2587bcd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:50.340526 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-848c1f69-3c70-4dcc-83a9-39f9c2587bcd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:50.347714 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-848c1f69-3c70-4dcc-83a9-39f9c2587bcd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.155216 Jul 19 09:30:50.348280 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 382/738] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:50 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:50.900205 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5cf32edf-a2d8-4b22-a6ee-476548a9ca86 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:50.900816 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5cf32edf-a2d8-4b22-a6ee-476548a9ca86 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:50.906618 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5cf32edf-a2d8-4b22-a6ee-476548a9ca86 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:50.907104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5cf32edf-a2d8-4b22-a6ee-476548a9ca86 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:50.907881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5cf32edf-a2d8-4b22-a6ee-476548a9ca86 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:50.908319 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5cf32edf-a2d8-4b22-a6ee-476548a9ca86 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:51.041999 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5cf32edf-a2d8-4b22-a6ee-476548a9ca86 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:51.050108 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5cf32edf-a2d8-4b22-a6ee-476548a9ca86 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:51.051653 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5cf32edf-a2d8-4b22-a6ee-476548a9ca86 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:51.052786 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5cf32edf-a2d8-4b22-a6ee-476548a9ca86 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.156327 Jul 19 09:30:51.053393 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 357/739] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:50 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:51.363776 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f03fd35c-564b-4020-9641-506411b2ede6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:51.364382 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f03fd35c-564b-4020-9641-506411b2ede6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:51.370000 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f03fd35c-564b-4020-9641-506411b2ede6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:51.370451 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f03fd35c-564b-4020-9641-506411b2ede6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:51.371238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f03fd35c-564b-4020-9641-506411b2ede6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:51.371672 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f03fd35c-564b-4020-9641-506411b2ede6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:51.502722 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f03fd35c-564b-4020-9641-506411b2ede6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:51.509976 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f03fd35c-564b-4020-9641-506411b2ede6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.149861 Jul 19 09:30:51.510539 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 383/740] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:51 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:52.071333 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-83c95990-f97c-498b-b193-c373a6966011 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:52.071941 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-83c95990-f97c-498b-b193-c373a6966011 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:52.078284 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-83c95990-f97c-498b-b193-c373a6966011 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:52.078734 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-83c95990-f97c-498b-b193-c373a6966011 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:52.079528 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-83c95990-f97c-498b-b193-c373a6966011 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:52.079961 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-83c95990-f97c-498b-b193-c373a6966011 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:52.210878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-83c95990-f97c-498b-b193-c373a6966011 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:52.219556 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-83c95990-f97c-498b-b193-c373a6966011 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:52.221058 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-83c95990-f97c-498b-b193-c373a6966011 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:52.222182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-83c95990-f97c-498b-b193-c373a6966011 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.154567 Jul 19 09:30:52.222735 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 358/741] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:52 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:52.527645 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-137c7a46-fc4d-47fc-8aa2-fd7bd5808f24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:52.528244 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-137c7a46-fc4d-47fc-8aa2-fd7bd5808f24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:52.533870 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-137c7a46-fc4d-47fc-8aa2-fd7bd5808f24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:52.534313 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-137c7a46-fc4d-47fc-8aa2-fd7bd5808f24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:52.535074 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-137c7a46-fc4d-47fc-8aa2-fd7bd5808f24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:52.535502 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-137c7a46-fc4d-47fc-8aa2-fd7bd5808f24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:52.665865 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-137c7a46-fc4d-47fc-8aa2-fd7bd5808f24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:52.673675 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-137c7a46-fc4d-47fc-8aa2-fd7bd5808f24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.150202 Jul 19 09:30:52.674238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 384/742] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:52 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:53.240136 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3e544fe5-ec7a-41f4-b166-967d5190ea9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:53.240756 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3e544fe5-ec7a-41f4-b166-967d5190ea9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:53.243194 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 09:30:53.248064 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e544fe5-ec7a-41f4-b166-967d5190ea9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:53.248511 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e544fe5-ec7a-41f4-b166-967d5190ea9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:53.249271 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e544fe5-ec7a-41f4-b166-967d5190ea9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:53.249703 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e544fe5-ec7a-41f4-b166-967d5190ea9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:53.384748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3e544fe5-ec7a-41f4-b166-967d5190ea9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:53.392971 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3e544fe5-ec7a-41f4-b166-967d5190ea9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:53.394467 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3e544fe5-ec7a-41f4-b166-967d5190ea9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:53.395638 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3e544fe5-ec7a-41f4-b166-967d5190ea9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.159205 Jul 19 09:30:53.396198 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 359/743] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:53 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:53.690267 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5cf7d7c2-6307-4227-92d7-961ff58bc766 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:53.690905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5cf7d7c2-6307-4227-92d7-961ff58bc766 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:53.696534 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5cf7d7c2-6307-4227-92d7-961ff58bc766 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:53.696979 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5cf7d7c2-6307-4227-92d7-961ff58bc766 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:53.697735 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5cf7d7c2-6307-4227-92d7-961ff58bc766 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:53.698166 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5cf7d7c2-6307-4227-92d7-961ff58bc766 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:53.830968 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5cf7d7c2-6307-4227-92d7-961ff58bc766 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:53.838276 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5cf7d7c2-6307-4227-92d7-961ff58bc766 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.151648 Jul 19 09:30:53.838853 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 385/744] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:53 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:54.414131 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9b65e310-81a3-45fa-8828-1eb030258c20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:54.414734 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9b65e310-81a3-45fa-8828-1eb030258c20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:54.431055 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9b65e310-81a3-45fa-8828-1eb030258c20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:54.431509 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9b65e310-81a3-45fa-8828-1eb030258c20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:54.432288 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9b65e310-81a3-45fa-8828-1eb030258c20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:54.432722 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9b65e310-81a3-45fa-8828-1eb030258c20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:54.448984 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 52968. Jul 19 09:30:54.569847 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9b65e310-81a3-45fa-8828-1eb030258c20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:54.578053 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9b65e310-81a3-45fa-8828-1eb030258c20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:54.579579 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9b65e310-81a3-45fa-8828-1eb030258c20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:54.580721 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9b65e310-81a3-45fa-8828-1eb030258c20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.170342 Jul 19 09:30:54.581278 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 360/745] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:54 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:54.855498 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e6f5b8ca-f3e1-4a76-8b4a-5b69c1398f5b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:54.856034 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e6f5b8ca-f3e1-4a76-8b4a-5b69c1398f5b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:54.861843 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e6f5b8ca-f3e1-4a76-8b4a-5b69c1398f5b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:54.862291 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e6f5b8ca-f3e1-4a76-8b4a-5b69c1398f5b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:54.863067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e6f5b8ca-f3e1-4a76-8b4a-5b69c1398f5b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:54.863496 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e6f5b8ca-f3e1-4a76-8b4a-5b69c1398f5b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:55.001160 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e6f5b8ca-f3e1-4a76-8b4a-5b69c1398f5b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:55.008431 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e6f5b8ca-f3e1-4a76-8b4a-5b69c1398f5b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.156691 Jul 19 09:30:55.009007 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 386/746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:54 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:55.599150 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f53b00e0-7be0-4064-8915-784fd46c14ae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:55.599735 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f53b00e0-7be0-4064-8915-784fd46c14ae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:55.606102 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f53b00e0-7be0-4064-8915-784fd46c14ae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:55.606553 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f53b00e0-7be0-4064-8915-784fd46c14ae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:55.607362 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f53b00e0-7be0-4064-8915-784fd46c14ae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:55.607799 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f53b00e0-7be0-4064-8915-784fd46c14ae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:55.737854 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f53b00e0-7be0-4064-8915-784fd46c14ae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:55.745997 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f53b00e0-7be0-4064-8915-784fd46c14ae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:55.747529 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f53b00e0-7be0-4064-8915-784fd46c14ae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:55.748658 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f53b00e0-7be0-4064-8915-784fd46c14ae tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153316 Jul 19 09:30:55.749221 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 361/747] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:55 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:56.026016 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-996f19a5-18c6-43e5-ad7d-0c68214e52d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:56.027183 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-996f19a5-18c6-43e5-ad7d-0c68214e52d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:56.032891 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-996f19a5-18c6-43e5-ad7d-0c68214e52d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:56.033334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-996f19a5-18c6-43e5-ad7d-0c68214e52d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:56.034088 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-996f19a5-18c6-43e5-ad7d-0c68214e52d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:56.034510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-996f19a5-18c6-43e5-ad7d-0c68214e52d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:56.166470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-996f19a5-18c6-43e5-ad7d-0c68214e52d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:56.173845 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-996f19a5-18c6-43e5-ad7d-0c68214e52d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152281 Jul 19 09:30:56.174420 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 387/748] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:56 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:56.766513 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9ee85a74-21a9-481f-a9fe-bd6554b165cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:56.767145 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9ee85a74-21a9-481f-a9fe-bd6554b165cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:56.772949 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ee85a74-21a9-481f-a9fe-bd6554b165cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:56.773390 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ee85a74-21a9-481f-a9fe-bd6554b165cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:56.774175 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ee85a74-21a9-481f-a9fe-bd6554b165cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:56.774599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ee85a74-21a9-481f-a9fe-bd6554b165cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:56.909290 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9ee85a74-21a9-481f-a9fe-bd6554b165cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:56.918183 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9ee85a74-21a9-481f-a9fe-bd6554b165cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:56.920169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9ee85a74-21a9-481f-a9fe-bd6554b165cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:56.921454 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9ee85a74-21a9-481f-a9fe-bd6554b165cb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.158643 Jul 19 09:30:56.922005 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 362/749] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:56 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:57.191372 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5824fafe-e6d7-4363-ab02-1ee6c41f0734 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:57.191985 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5824fafe-e6d7-4363-ab02-1ee6c41f0734 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:57.197812 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5824fafe-e6d7-4363-ab02-1ee6c41f0734 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:57.198264 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5824fafe-e6d7-4363-ab02-1ee6c41f0734 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:57.199606 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5824fafe-e6d7-4363-ab02-1ee6c41f0734 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:57.200045 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5824fafe-e6d7-4363-ab02-1ee6c41f0734 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:57.332328 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5824fafe-e6d7-4363-ab02-1ee6c41f0734 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:57.340090 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5824fafe-e6d7-4363-ab02-1ee6c41f0734 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152691 Jul 19 09:30:57.340666 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 388/750] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:57 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:57.939584 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fd2c05a5-b03e-4be5-94ca-4d5d59d4f9b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:57.940200 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fd2c05a5-b03e-4be5-94ca-4d5d59d4f9b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:57.946102 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fd2c05a5-b03e-4be5-94ca-4d5d59d4f9b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:57.946545 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fd2c05a5-b03e-4be5-94ca-4d5d59d4f9b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:57.947323 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fd2c05a5-b03e-4be5-94ca-4d5d59d4f9b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:57.947752 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fd2c05a5-b03e-4be5-94ca-4d5d59d4f9b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:58.080078 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fd2c05a5-b03e-4be5-94ca-4d5d59d4f9b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:58.088116 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fd2c05a5-b03e-4be5-94ca-4d5d59d4f9b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:58.089602 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fd2c05a5-b03e-4be5-94ca-4d5d59d4f9b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:58.090738 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fd2c05a5-b03e-4be5-94ca-4d5d59d4f9b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.154891 Jul 19 09:30:58.091317 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 363/751] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:57 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:58.357085 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-79ff6fa1-484b-4408-b0f5-16c5e7573bfa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:58.357693 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-79ff6fa1-484b-4408-b0f5-16c5e7573bfa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:58.363488 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-79ff6fa1-484b-4408-b0f5-16c5e7573bfa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:58.363950 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-79ff6fa1-484b-4408-b0f5-16c5e7573bfa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:58.364713 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-79ff6fa1-484b-4408-b0f5-16c5e7573bfa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:58.365148 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-79ff6fa1-484b-4408-b0f5-16c5e7573bfa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:58.504644 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-79ff6fa1-484b-4408-b0f5-16c5e7573bfa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:58.512432 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-79ff6fa1-484b-4408-b0f5-16c5e7573bfa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.159200 Jul 19 09:30:58.512996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 389/752] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:58 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:30:59.109599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-717780ff-67b3-4c4e-acac-97fed53e0ad9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:59.110202 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-717780ff-67b3-4c4e-acac-97fed53e0ad9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:59.115995 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-717780ff-67b3-4c4e-acac-97fed53e0ad9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:59.116436 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-717780ff-67b3-4c4e-acac-97fed53e0ad9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:59.117192 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-717780ff-67b3-4c4e-acac-97fed53e0ad9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:59.117622 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-717780ff-67b3-4c4e-acac-97fed53e0ad9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:59.248293 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-717780ff-67b3-4c4e-acac-97fed53e0ad9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:59.256671 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-717780ff-67b3-4c4e-acac-97fed53e0ad9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:59.258182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-717780ff-67b3-4c4e-acac-97fed53e0ad9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:59.259359 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-717780ff-67b3-4c4e-acac-97fed53e0ad9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153444 Jul 19 09:30:59.259925 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 364/753] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:30:59 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:30:59.529029 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6be9cb27-7444-40a2-9f18-a2e2db89d6cf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:30:59.529638 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6be9cb27-7444-40a2-9f18-a2e2db89d6cf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:30:59.535400 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6be9cb27-7444-40a2-9f18-a2e2db89d6cf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:59.535851 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6be9cb27-7444-40a2-9f18-a2e2db89d6cf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:59.536611 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6be9cb27-7444-40a2-9f18-a2e2db89d6cf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:30:59.537045 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6be9cb27-7444-40a2-9f18-a2e2db89d6cf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:30:59.670577 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6be9cb27-7444-40a2-9f18-a2e2db89d6cf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:30:59.677803 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6be9cb27-7444-40a2-9f18-a2e2db89d6cf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152379 Jul 19 09:30:59.678372 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 390/754] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:30:59 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:00.277875 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-439a49bf-33ed-400e-9ece-e12c84c80e21 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:00.278484 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-439a49bf-33ed-400e-9ece-e12c84c80e21 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:00.284351 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-439a49bf-33ed-400e-9ece-e12c84c80e21 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:00.284806 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-439a49bf-33ed-400e-9ece-e12c84c80e21 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:00.285610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-439a49bf-33ed-400e-9ece-e12c84c80e21 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:00.286050 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-439a49bf-33ed-400e-9ece-e12c84c80e21 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:00.426332 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-439a49bf-33ed-400e-9ece-e12c84c80e21 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:00.434559 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-439a49bf-33ed-400e-9ece-e12c84c80e21 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:00.436128 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-439a49bf-33ed-400e-9ece-e12c84c80e21 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:00.437263 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-439a49bf-33ed-400e-9ece-e12c84c80e21 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.163763 Jul 19 09:31:00.437822 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 365/755] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:00 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:00.694796 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-80f8babe-59c2-452d-8f17-51553a3fd36c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:00.695890 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-80f8babe-59c2-452d-8f17-51553a3fd36c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:00.701905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-80f8babe-59c2-452d-8f17-51553a3fd36c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:00.702354 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-80f8babe-59c2-452d-8f17-51553a3fd36c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:00.703141 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-80f8babe-59c2-452d-8f17-51553a3fd36c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:00.703572 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-80f8babe-59c2-452d-8f17-51553a3fd36c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:00.831812 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-80f8babe-59c2-452d-8f17-51553a3fd36c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:00.839501 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-80f8babe-59c2-452d-8f17-51553a3fd36c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.147906 Jul 19 09:31:00.840092 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 391/756] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:00 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:01.455418 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2c45ce65-5b58-420d-99f0-5ee363695c66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:01.455940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2c45ce65-5b58-420d-99f0-5ee363695c66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:01.461985 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2c45ce65-5b58-420d-99f0-5ee363695c66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:01.462489 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2c45ce65-5b58-420d-99f0-5ee363695c66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:01.463467 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2c45ce65-5b58-420d-99f0-5ee363695c66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:01.464403 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2c45ce65-5b58-420d-99f0-5ee363695c66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:01.595385 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2c45ce65-5b58-420d-99f0-5ee363695c66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:01.603421 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2c45ce65-5b58-420d-99f0-5ee363695c66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:01.605477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2c45ce65-5b58-420d-99f0-5ee363695c66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:01.606610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2c45ce65-5b58-420d-99f0-5ee363695c66 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155037 Jul 19 09:31:01.607192 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 366/757] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:01 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:01.856415 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e80fb10a-a8be-4f7c-a369-8e1c3f1ab6f7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:01.856961 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e80fb10a-a8be-4f7c-a369-8e1c3f1ab6f7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:01.862881 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e80fb10a-a8be-4f7c-a369-8e1c3f1ab6f7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:01.863369 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e80fb10a-a8be-4f7c-a369-8e1c3f1ab6f7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:01.864168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e80fb10a-a8be-4f7c-a369-8e1c3f1ab6f7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:01.864602 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e80fb10a-a8be-4f7c-a369-8e1c3f1ab6f7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:01.994170 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e80fb10a-a8be-4f7c-a369-8e1c3f1ab6f7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:02.001318 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e80fb10a-a8be-4f7c-a369-8e1c3f1ab6f7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.148699 Jul 19 09:31:02.001874 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 392/758] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:01 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:02.624675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5dbce22c-3445-47ec-84b1-e7fa5e2cc2fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:02.625216 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5dbce22c-3445-47ec-84b1-e7fa5e2cc2fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:02.630970 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5dbce22c-3445-47ec-84b1-e7fa5e2cc2fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:02.631451 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5dbce22c-3445-47ec-84b1-e7fa5e2cc2fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:02.632212 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5dbce22c-3445-47ec-84b1-e7fa5e2cc2fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:02.632640 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5dbce22c-3445-47ec-84b1-e7fa5e2cc2fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:02.767098 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5dbce22c-3445-47ec-84b1-e7fa5e2cc2fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:02.775186 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5dbce22c-3445-47ec-84b1-e7fa5e2cc2fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:02.777262 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5dbce22c-3445-47ec-84b1-e7fa5e2cc2fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:02.778399 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5dbce22c-3445-47ec-84b1-e7fa5e2cc2fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.157533 Jul 19 09:31:02.778987 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 367/759] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:02 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:03.017842 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-46a095bd-346c-4a63-9c15-15dd96554725 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:03.018447 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-46a095bd-346c-4a63-9c15-15dd96554725 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:03.024224 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-46a095bd-346c-4a63-9c15-15dd96554725 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:03.024675 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-46a095bd-346c-4a63-9c15-15dd96554725 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:03.025439 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-46a095bd-346c-4a63-9c15-15dd96554725 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:03.025877 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-46a095bd-346c-4a63-9c15-15dd96554725 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:03.171249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-46a095bd-346c-4a63-9c15-15dd96554725 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:03.178507 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-46a095bd-346c-4a63-9c15-15dd96554725 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.164289 Jul 19 09:31:03.179088 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 393/760] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:03 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:03.796822 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e096c8a9-8e45-4594-b4c5-79bc2d038ac6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:03.797460 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e096c8a9-8e45-4594-b4c5-79bc2d038ac6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:03.803268 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e096c8a9-8e45-4594-b4c5-79bc2d038ac6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:03.803724 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e096c8a9-8e45-4594-b4c5-79bc2d038ac6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:03.804487 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e096c8a9-8e45-4594-b4c5-79bc2d038ac6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:03.804920 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e096c8a9-8e45-4594-b4c5-79bc2d038ac6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:03.936041 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e096c8a9-8e45-4594-b4c5-79bc2d038ac6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:03.944145 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e096c8a9-8e45-4594-b4c5-79bc2d038ac6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:03.945639 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e096c8a9-8e45-4594-b4c5-79bc2d038ac6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:03.946763 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e096c8a9-8e45-4594-b4c5-79bc2d038ac6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153675 Jul 19 09:31:03.947374 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 368/761] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:03 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:04.195916 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9046f85d-059e-4ad0-b5f8-284d2f181e6a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:04.196543 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9046f85d-059e-4ad0-b5f8-284d2f181e6a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:04.202980 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9046f85d-059e-4ad0-b5f8-284d2f181e6a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:04.203464 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9046f85d-059e-4ad0-b5f8-284d2f181e6a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:04.204230 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9046f85d-059e-4ad0-b5f8-284d2f181e6a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:04.204662 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9046f85d-059e-4ad0-b5f8-284d2f181e6a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:04.337154 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9046f85d-059e-4ad0-b5f8-284d2f181e6a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:04.344574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9046f85d-059e-4ad0-b5f8-284d2f181e6a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152397 Jul 19 09:31:04.345135 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 394/762] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:04 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:04.965272 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b0599112-3ec4-4077-a26a-59841584fb0f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:04.965877 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b0599112-3ec4-4077-a26a-59841584fb0f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:04.971735 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b0599112-3ec4-4077-a26a-59841584fb0f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:04.972183 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b0599112-3ec4-4077-a26a-59841584fb0f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:04.972943 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b0599112-3ec4-4077-a26a-59841584fb0f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:04.973377 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b0599112-3ec4-4077-a26a-59841584fb0f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:05.103636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b0599112-3ec4-4077-a26a-59841584fb0f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:05.111849 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b0599112-3ec4-4077-a26a-59841584fb0f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:05.113353 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b0599112-3ec4-4077-a26a-59841584fb0f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:05.114490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b0599112-3ec4-4077-a26a-59841584fb0f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153010 Jul 19 09:31:05.115055 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 369/763] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:04 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:05.361070 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1794c7e3-b9e6-4022-a9a3-06071b319d81 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:05.361605 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1794c7e3-b9e6-4022-a9a3-06071b319d81 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:05.363949 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 09:31:05.368399 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1794c7e3-b9e6-4022-a9a3-06071b319d81 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:05.368844 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1794c7e3-b9e6-4022-a9a3-06071b319d81 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:05.369597 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1794c7e3-b9e6-4022-a9a3-06071b319d81 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:05.370680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1794c7e3-b9e6-4022-a9a3-06071b319d81 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:05.502910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1794c7e3-b9e6-4022-a9a3-06071b319d81 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:05.510098 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1794c7e3-b9e6-4022-a9a3-06071b319d81 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152771 Jul 19 09:31:05.510653 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 395/764] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:05 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:06.132805 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0c531f91-d35c-42c9-b674-a0bf091af151 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:06.133411 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0c531f91-d35c-42c9-b674-a0bf091af151 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:06.139397 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c531f91-d35c-42c9-b674-a0bf091af151 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:06.139852 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c531f91-d35c-42c9-b674-a0bf091af151 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:06.140625 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c531f91-d35c-42c9-b674-a0bf091af151 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:06.141060 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c531f91-d35c-42c9-b674-a0bf091af151 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:06.274469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0c531f91-d35c-42c9-b674-a0bf091af151 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:06.283263 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0c531f91-d35c-42c9-b674-a0bf091af151 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:06.284764 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0c531f91-d35c-42c9-b674-a0bf091af151 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:06.285894 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0c531f91-d35c-42c9-b674-a0bf091af151 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.156829 Jul 19 09:31:06.286492 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 370/765] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:06 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:06.527416 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a11e299c-7e44-430e-951e-e5cb9dfaeffe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:06.527982 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a11e299c-7e44-430e-951e-e5cb9dfaeffe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:06.545885 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a11e299c-7e44-430e-951e-e5cb9dfaeffe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:06.546345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a11e299c-7e44-430e-951e-e5cb9dfaeffe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:06.547154 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a11e299c-7e44-430e-951e-e5cb9dfaeffe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:06.547595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a11e299c-7e44-430e-951e-e5cb9dfaeffe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:06.552734 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53012. Jul 19 09:31:06.677987 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a11e299c-7e44-430e-951e-e5cb9dfaeffe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:06.685673 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a11e299c-7e44-430e-951e-e5cb9dfaeffe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.162574 Jul 19 09:31:06.686234 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 396/766] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:06 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:07.304777 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1c4da5d9-ce7a-4a4d-904f-ae18d75a1ec3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:07.305386 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1c4da5d9-ce7a-4a4d-904f-ae18d75a1ec3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:07.311808 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c4da5d9-ce7a-4a4d-904f-ae18d75a1ec3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:07.312252 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c4da5d9-ce7a-4a4d-904f-ae18d75a1ec3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:07.313010 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c4da5d9-ce7a-4a4d-904f-ae18d75a1ec3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:07.313442 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c4da5d9-ce7a-4a4d-904f-ae18d75a1ec3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:07.442574 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1c4da5d9-ce7a-4a4d-904f-ae18d75a1ec3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:07.450758 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1c4da5d9-ce7a-4a4d-904f-ae18d75a1ec3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:07.452352 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1c4da5d9-ce7a-4a4d-904f-ae18d75a1ec3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:07.453487 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1c4da5d9-ce7a-4a4d-904f-ae18d75a1ec3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152422 Jul 19 09:31:07.454045 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 371/767] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:07 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:07.702740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3614f0d7-269f-4567-8403-a8523ffeb1c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:07.703302 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3614f0d7-269f-4567-8403-a8523ffeb1c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:07.708970 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3614f0d7-269f-4567-8403-a8523ffeb1c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:07.709403 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3614f0d7-269f-4567-8403-a8523ffeb1c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:07.710168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3614f0d7-269f-4567-8403-a8523ffeb1c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:07.710604 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3614f0d7-269f-4567-8403-a8523ffeb1c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:07.839618 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3614f0d7-269f-4567-8403-a8523ffeb1c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:07.846812 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3614f0d7-269f-4567-8403-a8523ffeb1c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.147830 Jul 19 09:31:07.847407 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 397/768] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:07 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:08.472185 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6f609afc-6a9a-4141-9420-69e1cccdf90a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:08.472826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6f609afc-6a9a-4141-9420-69e1cccdf90a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:08.478991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6f609afc-6a9a-4141-9420-69e1cccdf90a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:08.479979 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6f609afc-6a9a-4141-9420-69e1cccdf90a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:08.480748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6f609afc-6a9a-4141-9420-69e1cccdf90a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:08.481185 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6f609afc-6a9a-4141-9420-69e1cccdf90a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:08.614169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6f609afc-6a9a-4141-9420-69e1cccdf90a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:08.622883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6f609afc-6a9a-4141-9420-69e1cccdf90a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:08.624405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6f609afc-6a9a-4141-9420-69e1cccdf90a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:08.625523 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6f609afc-6a9a-4141-9420-69e1cccdf90a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.157181 Jul 19 09:31:08.626082 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 372/769] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:08 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:31:08.862750 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0ef50255-68fd-48ad-9f0e-0617292b25f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:08.863304 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0ef50255-68fd-48ad-9f0e-0617292b25f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:08.869062 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0ef50255-68fd-48ad-9f0e-0617292b25f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:08.869510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0ef50255-68fd-48ad-9f0e-0617292b25f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:08.870267 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0ef50255-68fd-48ad-9f0e-0617292b25f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:08.870696 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0ef50255-68fd-48ad-9f0e-0617292b25f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:09.001477 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0ef50255-68fd-48ad-9f0e-0617292b25f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:09.008625 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0ef50255-68fd-48ad-9f0e-0617292b25f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.149545 Jul 19 09:31:09.009182 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 398/770] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:08 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:09.642953 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a051d80d-54db-4475-9e06-b408bdbd3efe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:09.643546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a051d80d-54db-4475-9e06-b408bdbd3efe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:09.649373 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a051d80d-54db-4475-9e06-b408bdbd3efe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:09.649819 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a051d80d-54db-4475-9e06-b408bdbd3efe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:09.650580 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a051d80d-54db-4475-9e06-b408bdbd3efe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:09.651014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a051d80d-54db-4475-9e06-b408bdbd3efe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:09.780986 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a051d80d-54db-4475-9e06-b408bdbd3efe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:09.789093 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a051d80d-54db-4475-9e06-b408bdbd3efe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:09.790850 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a051d80d-54db-4475-9e06-b408bdbd3efe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:09.792011 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a051d80d-54db-4475-9e06-b408bdbd3efe tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152805 Jul 19 09:31:09.792575 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 373/771] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:09 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:10.025303 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a9cbacb4-5e26-4902-b600-bb603f4130de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:10.025944 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a9cbacb4-5e26-4902-b600-bb603f4130de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:10.031675 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a9cbacb4-5e26-4902-b600-bb603f4130de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:10.032126 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a9cbacb4-5e26-4902-b600-bb603f4130de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:10.032883 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a9cbacb4-5e26-4902-b600-bb603f4130de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:10.033314 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a9cbacb4-5e26-4902-b600-bb603f4130de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:10.162408 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a9cbacb4-5e26-4902-b600-bb603f4130de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:10.170475 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a9cbacb4-5e26-4902-b600-bb603f4130de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.148762 Jul 19 09:31:10.171065 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 399/772] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:10 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:10.810177 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-79fa1858-1cae-4e96-9856-89a79f995012 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:10.810778 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-79fa1858-1cae-4e96-9856-89a79f995012 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:10.816547 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79fa1858-1cae-4e96-9856-89a79f995012 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:10.816988 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79fa1858-1cae-4e96-9856-89a79f995012 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:10.817743 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79fa1858-1cae-4e96-9856-89a79f995012 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:10.818169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-79fa1858-1cae-4e96-9856-89a79f995012 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:10.948252 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-79fa1858-1cae-4e96-9856-89a79f995012 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:10.956250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-79fa1858-1cae-4e96-9856-89a79f995012 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:10.958016 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-79fa1858-1cae-4e96-9856-89a79f995012 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:10.959164 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-79fa1858-1cae-4e96-9856-89a79f995012 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.153003 Jul 19 09:31:10.959713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 374/773] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:10 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:11.187663 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1ebff6d9-0953-46ce-b312-74d3d6901d53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:11.188271 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1ebff6d9-0953-46ce-b312-74d3d6901d53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:11.194016 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ebff6d9-0953-46ce-b312-74d3d6901d53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:11.194474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ebff6d9-0953-46ce-b312-74d3d6901d53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:11.195255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ebff6d9-0953-46ce-b312-74d3d6901d53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:11.195686 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ebff6d9-0953-46ce-b312-74d3d6901d53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:11.329203 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1ebff6d9-0953-46ce-b312-74d3d6901d53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:11.336477 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1ebff6d9-0953-46ce-b312-74d3d6901d53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152466 Jul 19 09:31:11.337040 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 400/774] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:11 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:11.976840 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-dd14cf1e-e041-40fb-a4b9-cf172ab233bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:11.977579 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-dd14cf1e-e041-40fb-a4b9-cf172ab233bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:11.983760 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dd14cf1e-e041-40fb-a4b9-cf172ab233bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:11.984204 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dd14cf1e-e041-40fb-a4b9-cf172ab233bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:11.984952 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dd14cf1e-e041-40fb-a4b9-cf172ab233bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:11.985511 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dd14cf1e-e041-40fb-a4b9-cf172ab233bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:12.117781 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-dd14cf1e-e041-40fb-a4b9-cf172ab233bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:12.126337 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-dd14cf1e-e041-40fb-a4b9-cf172ab233bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:12.127857 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-dd14cf1e-e041-40fb-a4b9-cf172ab233bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:12.128970 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-dd14cf1e-e041-40fb-a4b9-cf172ab233bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.155824 Jul 19 09:31:12.129522 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 375/775] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:11 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:31:12.353078 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-91f8f790-d076-4bc6-a261-dbfe2dae6045 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:12.353611 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-91f8f790-d076-4bc6-a261-dbfe2dae6045 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:12.359996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-91f8f790-d076-4bc6-a261-dbfe2dae6045 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:12.360445 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-91f8f790-d076-4bc6-a261-dbfe2dae6045 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:12.361199 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-91f8f790-d076-4bc6-a261-dbfe2dae6045 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:12.361629 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-91f8f790-d076-4bc6-a261-dbfe2dae6045 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:12.492220 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-91f8f790-d076-4bc6-a261-dbfe2dae6045 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:12.499584 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-91f8f790-d076-4bc6-a261-dbfe2dae6045 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.150209 Jul 19 09:31:12.500143 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 401/776] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:12 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:13.147285 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c79abe05-eead-48fd-8a33-44e6c792005d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:13.147891 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c79abe05-eead-48fd-8a33-44e6c792005d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:13.153754 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c79abe05-eead-48fd-8a33-44e6c792005d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:13.154199 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c79abe05-eead-48fd-8a33-44e6c792005d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:13.154952 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c79abe05-eead-48fd-8a33-44e6c792005d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:13.155412 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c79abe05-eead-48fd-8a33-44e6c792005d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:13.284746 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c79abe05-eead-48fd-8a33-44e6c792005d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:13.293688 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c79abe05-eead-48fd-8a33-44e6c792005d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:13.295222 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c79abe05-eead-48fd-8a33-44e6c792005d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:13.296371 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c79abe05-eead-48fd-8a33-44e6c792005d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.152792 Jul 19 09:31:13.296907 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 376/777] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:13 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:13.517050 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b960fe23-e4ad-43e7-a2bb-5aa57a375dd1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:13.517655 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b960fe23-e4ad-43e7-a2bb-5aa57a375dd1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:13.523450 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b960fe23-e4ad-43e7-a2bb-5aa57a375dd1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:13.523897 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b960fe23-e4ad-43e7-a2bb-5aa57a375dd1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:13.524656 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b960fe23-e4ad-43e7-a2bb-5aa57a375dd1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:13.525088 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b960fe23-e4ad-43e7-a2bb-5aa57a375dd1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:13.654654 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b960fe23-e4ad-43e7-a2bb-5aa57a375dd1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:13.661826 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b960fe23-e4ad-43e7-a2bb-5aa57a375dd1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.148438 Jul 19 09:31:13.662394 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 402/778] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:13 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:14.314065 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-db8d207c-77dc-459d-ad0c-d650eadfa672 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:14.314689 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-db8d207c-77dc-459d-ad0c-d650eadfa672 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:14.320538 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-db8d207c-77dc-459d-ad0c-d650eadfa672 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:14.320927 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-db8d207c-77dc-459d-ad0c-d650eadfa672 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:14.321687 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-db8d207c-77dc-459d-ad0c-d650eadfa672 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:14.322112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-db8d207c-77dc-459d-ad0c-d650eadfa672 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:14.455412 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-db8d207c-77dc-459d-ad0c-d650eadfa672 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:14.464093 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-db8d207c-77dc-459d-ad0c-d650eadfa672 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:14.465654 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-db8d207c-77dc-459d-ad0c-d650eadfa672 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:14.466774 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-db8d207c-77dc-459d-ad0c-d650eadfa672 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1751 microversion: 2.20 time: 0.156414 Jul 19 09:31:14.467377 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 377/779] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:14 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:14.678399 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7b209433-394a-4773-8c8d-8f7df30050ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:14.679000 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7b209433-394a-4773-8c8d-8f7df30050ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:14.685482 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b209433-394a-4773-8c8d-8f7df30050ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:14.686196 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b209433-394a-4773-8c8d-8f7df30050ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:14.686959 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b209433-394a-4773-8c8d-8f7df30050ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:14.687442 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b209433-394a-4773-8c8d-8f7df30050ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:14.835011 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7b209433-394a-4773-8c8d-8f7df30050ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:14.842990 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7b209433-394a-4773-8c8d-8f7df30050ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.168355 Jul 19 09:31:14.843586 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 403/780] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:14 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:15.485249 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ee8d9042-42ef-42c4-9c5e-7f667188f978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:15.485857 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ee8d9042-42ef-42c4-9c5e-7f667188f978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:15.491881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ee8d9042-42ef-42c4-9c5e-7f667188f978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:15.492361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ee8d9042-42ef-42c4-9c5e-7f667188f978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:15.493130 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ee8d9042-42ef-42c4-9c5e-7f667188f978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:15.493564 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ee8d9042-42ef-42c4-9c5e-7f667188f978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:15.624367 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ee8d9042-42ef-42c4-9c5e-7f667188f978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:15.632507 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ee8d9042-42ef-42c4-9c5e-7f667188f978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:15.634007 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ee8d9042-42ef-42c4-9c5e-7f667188f978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:15.635169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ee8d9042-42ef-42c4-9c5e-7f667188f978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153619 Jul 19 09:31:15.635732 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 378/781] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:15 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:15.859794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1c299ce8-3638-4aed-b226-e3e7a5b621a7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:15.860310 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1c299ce8-3638-4aed-b226-e3e7a5b621a7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:15.866025 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c299ce8-3638-4aed-b226-e3e7a5b621a7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:15.866467 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c299ce8-3638-4aed-b226-e3e7a5b621a7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:15.867269 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c299ce8-3638-4aed-b226-e3e7a5b621a7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:15.867697 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c299ce8-3638-4aed-b226-e3e7a5b621a7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:15.998482 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1c299ce8-3638-4aed-b226-e3e7a5b621a7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:16.005780 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1c299ce8-3638-4aed-b226-e3e7a5b621a7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.149714 Jul 19 09:31:16.006345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 404/782] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:15 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:16.654323 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-12e07bad-a7a8-4ced-a3a8-5a282e0501c0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:16.654857 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-12e07bad-a7a8-4ced-a3a8-5a282e0501c0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:16.660814 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12e07bad-a7a8-4ced-a3a8-5a282e0501c0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:16.661304 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12e07bad-a7a8-4ced-a3a8-5a282e0501c0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:16.662022 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12e07bad-a7a8-4ced-a3a8-5a282e0501c0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:16.662455 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12e07bad-a7a8-4ced-a3a8-5a282e0501c0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:16.793001 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-12e07bad-a7a8-4ced-a3a8-5a282e0501c0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:16.801167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-12e07bad-a7a8-4ced-a3a8-5a282e0501c0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:16.802669 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-12e07bad-a7a8-4ced-a3a8-5a282e0501c0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:16.803829 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-12e07bad-a7a8-4ced-a3a8-5a282e0501c0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153838 Jul 19 09:31:16.804379 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 379/783] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:16 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:17.023001 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b30b3456-cf10-44f5-a5ed-b08eb3494497 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:17.023605 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b30b3456-cf10-44f5-a5ed-b08eb3494497 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:17.029860 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b30b3456-cf10-44f5-a5ed-b08eb3494497 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:17.030303 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b30b3456-cf10-44f5-a5ed-b08eb3494497 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:17.031082 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b30b3456-cf10-44f5-a5ed-b08eb3494497 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:17.031510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b30b3456-cf10-44f5-a5ed-b08eb3494497 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:17.165853 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b30b3456-cf10-44f5-a5ed-b08eb3494497 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:17.173742 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b30b3456-cf10-44f5-a5ed-b08eb3494497 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.154519 Jul 19 09:31:17.174297 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 405/784] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:17 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:17.822282 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-65fb29c4-2258-4ec7-8adf-2da21f56dbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:17.822885 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-65fb29c4-2258-4ec7-8adf-2da21f56dbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:17.828653 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-65fb29c4-2258-4ec7-8adf-2da21f56dbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:17.829098 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-65fb29c4-2258-4ec7-8adf-2da21f56dbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:17.829863 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-65fb29c4-2258-4ec7-8adf-2da21f56dbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:17.830294 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-65fb29c4-2258-4ec7-8adf-2da21f56dbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:17.964129 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-65fb29c4-2258-4ec7-8adf-2da21f56dbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:17.972528 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-65fb29c4-2258-4ec7-8adf-2da21f56dbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:17.974080 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-65fb29c4-2258-4ec7-8adf-2da21f56dbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:17.975334 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-65fb29c4-2258-4ec7-8adf-2da21f56dbda tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156769 Jul 19 09:31:17.975893 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 380/785] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:17 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:31:18.189451 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b90dc773-0c14-458b-896e-24ceae511837 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:18.190064 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b90dc773-0c14-458b-896e-24ceae511837 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:18.195922 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b90dc773-0c14-458b-896e-24ceae511837 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:18.196374 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b90dc773-0c14-458b-896e-24ceae511837 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:18.197141 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b90dc773-0c14-458b-896e-24ceae511837 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:18.198071 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b90dc773-0c14-458b-896e-24ceae511837 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:18.327159 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b90dc773-0c14-458b-896e-24ceae511837 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:18.334348 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b90dc773-0c14-458b-896e-24ceae511837 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.148585 Jul 19 09:31:18.334919 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 406/786] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:18 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:18.993666 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e00e14b4-8d83-4fad-b7be-638b0ae82b85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:18.994884 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e00e14b4-8d83-4fad-b7be-638b0ae82b85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:19.000688 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e00e14b4-8d83-4fad-b7be-638b0ae82b85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:19.001131 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e00e14b4-8d83-4fad-b7be-638b0ae82b85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:19.001882 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e00e14b4-8d83-4fad-b7be-638b0ae82b85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:19.002312 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e00e14b4-8d83-4fad-b7be-638b0ae82b85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:19.134285 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e00e14b4-8d83-4fad-b7be-638b0ae82b85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:19.143721 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e00e14b4-8d83-4fad-b7be-638b0ae82b85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:19.145205 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e00e14b4-8d83-4fad-b7be-638b0ae82b85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:19.146331 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e00e14b4-8d83-4fad-b7be-638b0ae82b85 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156373 Jul 19 09:31:19.146879 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 381/787] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:18 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:19.350634 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0861acb6-ac71-422b-9eb4-ad97c889338a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:19.351198 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0861acb6-ac71-422b-9eb4-ad97c889338a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:19.357590 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0861acb6-ac71-422b-9eb4-ad97c889338a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:19.358067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0861acb6-ac71-422b-9eb4-ad97c889338a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:19.358823 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0861acb6-ac71-422b-9eb4-ad97c889338a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:19.359285 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0861acb6-ac71-422b-9eb4-ad97c889338a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:19.487114 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0861acb6-ac71-422b-9eb4-ad97c889338a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:19.494351 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0861acb6-ac71-422b-9eb4-ad97c889338a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.147420 Jul 19 09:31:19.494909 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 407/788] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:19 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:20.164774 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cb283898-08b4-41f8-b637-dc2832765a4d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:20.165642 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cb283898-08b4-41f8-b637-dc2832765a4d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:20.171560 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cb283898-08b4-41f8-b637-dc2832765a4d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:20.172012 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cb283898-08b4-41f8-b637-dc2832765a4d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:20.172781 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cb283898-08b4-41f8-b637-dc2832765a4d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:20.173216 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cb283898-08b4-41f8-b637-dc2832765a4d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:20.306119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cb283898-08b4-41f8-b637-dc2832765a4d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:20.314927 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cb283898-08b4-41f8-b637-dc2832765a4d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:20.316531 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cb283898-08b4-41f8-b637-dc2832765a4d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:20.317691 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cb283898-08b4-41f8-b637-dc2832765a4d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156724 Jul 19 09:31:20.318365 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 382/789] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:20 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:20.510885 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6172fb13-898b-4d41-8cf3-a3abcda4de5c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:20.511542 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6172fb13-898b-4d41-8cf3-a3abcda4de5c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:20.517311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6172fb13-898b-4d41-8cf3-a3abcda4de5c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:20.517760 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6172fb13-898b-4d41-8cf3-a3abcda4de5c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:20.518521 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6172fb13-898b-4d41-8cf3-a3abcda4de5c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:20.518957 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6172fb13-898b-4d41-8cf3-a3abcda4de5c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:20.658628 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6172fb13-898b-4d41-8cf3-a3abcda4de5c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:20.666692 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6172fb13-898b-4d41-8cf3-a3abcda4de5c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.158954 Jul 19 09:31:20.667276 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 408/790] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:20 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:21.335919 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6b4f167d-3331-4863-a64c-5b31fd2fceea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:21.336520 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6b4f167d-3331-4863-a64c-5b31fd2fceea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:21.342202 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b4f167d-3331-4863-a64c-5b31fd2fceea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:21.342642 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b4f167d-3331-4863-a64c-5b31fd2fceea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:21.343422 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b4f167d-3331-4863-a64c-5b31fd2fceea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:21.343848 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b4f167d-3331-4863-a64c-5b31fd2fceea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:21.474263 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6b4f167d-3331-4863-a64c-5b31fd2fceea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:21.482443 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6b4f167d-3331-4863-a64c-5b31fd2fceea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:21.483966 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6b4f167d-3331-4863-a64c-5b31fd2fceea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:21.485085 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6b4f167d-3331-4863-a64c-5b31fd2fceea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.152987 Jul 19 09:31:21.485637 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 383/791] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:21 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:21.684249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-53950361-370b-4031-85a1-edb146ad44d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:21.684759 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-53950361-370b-4031-85a1-edb146ad44d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:21.690433 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-53950361-370b-4031-85a1-edb146ad44d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:21.690874 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-53950361-370b-4031-85a1-edb146ad44d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:21.691655 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-53950361-370b-4031-85a1-edb146ad44d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:21.692081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-53950361-370b-4031-85a1-edb146ad44d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:21.822548 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-53950361-370b-4031-85a1-edb146ad44d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:21.829910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-53950361-370b-4031-85a1-edb146ad44d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.149808 Jul 19 09:31:21.833143 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 409/792] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:21 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:22.502922 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f87a9809-c4fa-44ee-82e4-47dd7b89c0a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:22.503691 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f87a9809-c4fa-44ee-82e4-47dd7b89c0a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:22.509320 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f87a9809-c4fa-44ee-82e4-47dd7b89c0a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:22.510339 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f87a9809-c4fa-44ee-82e4-47dd7b89c0a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:22.511112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f87a9809-c4fa-44ee-82e4-47dd7b89c0a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:22.511545 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f87a9809-c4fa-44ee-82e4-47dd7b89c0a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:22.642697 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f87a9809-c4fa-44ee-82e4-47dd7b89c0a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:22.650890 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f87a9809-c4fa-44ee-82e4-47dd7b89c0a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:22.652424 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f87a9809-c4fa-44ee-82e4-47dd7b89c0a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:22.653552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f87a9809-c4fa-44ee-82e4-47dd7b89c0a1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154383 Jul 19 09:31:22.654103 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 384/793] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:22 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:22.847101 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9942100a-5b1a-4fc2-af84-af997cf9e0e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:22.847636 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9942100a-5b1a-4fc2-af84-af997cf9e0e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:22.853872 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9942100a-5b1a-4fc2-af84-af997cf9e0e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:22.854318 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9942100a-5b1a-4fc2-af84-af997cf9e0e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:22.855095 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9942100a-5b1a-4fc2-af84-af997cf9e0e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:22.855522 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9942100a-5b1a-4fc2-af84-af997cf9e0e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:22.988951 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9942100a-5b1a-4fc2-af84-af997cf9e0e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:22.996191 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9942100a-5b1a-4fc2-af84-af997cf9e0e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152900 Jul 19 09:31:22.996753 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 410/794] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:22 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:23.672274 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-114c85e9-f0a5-494b-b75d-074398fdd773 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:23.672882 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-114c85e9-f0a5-494b-b75d-074398fdd773 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:23.678708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-114c85e9-f0a5-494b-b75d-074398fdd773 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:23.679197 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-114c85e9-f0a5-494b-b75d-074398fdd773 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:23.679969 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-114c85e9-f0a5-494b-b75d-074398fdd773 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:23.680407 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-114c85e9-f0a5-494b-b75d-074398fdd773 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:23.815975 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-114c85e9-f0a5-494b-b75d-074398fdd773 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:23.824236 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-114c85e9-f0a5-494b-b75d-074398fdd773 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:23.825744 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-114c85e9-f0a5-494b-b75d-074398fdd773 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:23.826878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-114c85e9-f0a5-494b-b75d-074398fdd773 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.158353 Jul 19 09:31:23.827470 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 385/795] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:23 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:24.012906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-05fe5aeb-8b80-47c9-8d59-a6669b467afd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:24.013412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-05fe5aeb-8b80-47c9-8d59-a6669b467afd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:24.019187 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-05fe5aeb-8b80-47c9-8d59-a6669b467afd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:24.019634 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-05fe5aeb-8b80-47c9-8d59-a6669b467afd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:24.020391 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-05fe5aeb-8b80-47c9-8d59-a6669b467afd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:24.020820 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-05fe5aeb-8b80-47c9-8d59-a6669b467afd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:24.151351 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-05fe5aeb-8b80-47c9-8d59-a6669b467afd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:24.158676 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-05fe5aeb-8b80-47c9-8d59-a6669b467afd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.149530 Jul 19 09:31:24.159267 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 411/796] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:24 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:24.844868 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9bd8b96a-0a1a-4c13-93b3-5f2ba2cdfed3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:24.845603 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9bd8b96a-0a1a-4c13-93b3-5f2ba2cdfed3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:24.851393 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9bd8b96a-0a1a-4c13-93b3-5f2ba2cdfed3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:24.851843 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9bd8b96a-0a1a-4c13-93b3-5f2ba2cdfed3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:24.852603 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9bd8b96a-0a1a-4c13-93b3-5f2ba2cdfed3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:24.853037 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9bd8b96a-0a1a-4c13-93b3-5f2ba2cdfed3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:24.983943 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9bd8b96a-0a1a-4c13-93b3-5f2ba2cdfed3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:24.992081 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9bd8b96a-0a1a-4c13-93b3-5f2ba2cdfed3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:24.993608 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9bd8b96a-0a1a-4c13-93b3-5f2ba2cdfed3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:24.995318 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9bd8b96a-0a1a-4c13-93b3-5f2ba2cdfed3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154152 Jul 19 09:31:24.995876 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 386/797] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:24 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:25.175907 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1ad6774f-5f54-465d-be28-a6f185ab5e85 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:25.176518 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1ad6774f-5f54-465d-be28-a6f185ab5e85 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:25.182892 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ad6774f-5f54-465d-be28-a6f185ab5e85 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:25.183374 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ad6774f-5f54-465d-be28-a6f185ab5e85 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:25.184144 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ad6774f-5f54-465d-be28-a6f185ab5e85 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:25.184581 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ad6774f-5f54-465d-be28-a6f185ab5e85 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:25.312735 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1ad6774f-5f54-465d-be28-a6f185ab5e85 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:25.319983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1ad6774f-5f54-465d-be28-a6f185ab5e85 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.147917 Jul 19 09:31:25.320557 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 412/798] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:25 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:26.013237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-88a3eb65-0858-42ce-9d37-439ecc46e84f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:26.013826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-88a3eb65-0858-42ce-9d37-439ecc46e84f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:26.019650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-88a3eb65-0858-42ce-9d37-439ecc46e84f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:26.020094 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-88a3eb65-0858-42ce-9d37-439ecc46e84f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:26.020853 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-88a3eb65-0858-42ce-9d37-439ecc46e84f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:26.021287 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-88a3eb65-0858-42ce-9d37-439ecc46e84f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:26.154829 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-88a3eb65-0858-42ce-9d37-439ecc46e84f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:26.163008 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-88a3eb65-0858-42ce-9d37-439ecc46e84f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:26.164536 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-88a3eb65-0858-42ce-9d37-439ecc46e84f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:26.166547 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-88a3eb65-0858-42ce-9d37-439ecc46e84f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156475 Jul 19 09:31:26.167119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 387/799] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:26 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:26.335650 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cf32e519-00a8-49fb-bb52-c9c817897635 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:26.336185 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-cf32e519-00a8-49fb-bb52-c9c817897635 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:26.342340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf32e519-00a8-49fb-bb52-c9c817897635 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:26.342783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf32e519-00a8-49fb-bb52-c9c817897635 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:26.343573 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf32e519-00a8-49fb-bb52-c9c817897635 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:26.344002 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf32e519-00a8-49fb-bb52-c9c817897635 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:26.477399 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cf32e519-00a8-49fb-bb52-c9c817897635 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:26.485242 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-cf32e519-00a8-49fb-bb52-c9c817897635 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.153336 Jul 19 09:31:26.485810 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 413/800] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:26 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:27.185193 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-86319a71-7411-46e4-b9cd-3b44ce94c76e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:27.185794 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-86319a71-7411-46e4-b9cd-3b44ce94c76e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:27.191657 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86319a71-7411-46e4-b9cd-3b44ce94c76e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:27.192100 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86319a71-7411-46e4-b9cd-3b44ce94c76e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:27.192847 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86319a71-7411-46e4-b9cd-3b44ce94c76e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:27.193277 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86319a71-7411-46e4-b9cd-3b44ce94c76e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:27.323133 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-86319a71-7411-46e4-b9cd-3b44ce94c76e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:27.331259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-86319a71-7411-46e4-b9cd-3b44ce94c76e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:27.332807 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-86319a71-7411-46e4-b9cd-3b44ce94c76e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:27.333947 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-86319a71-7411-46e4-b9cd-3b44ce94c76e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.152941 Jul 19 09:31:27.334510 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 388/801] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:27 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:27.502849 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7f435422-0031-45ef-990e-cad7c31f19ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:27.503403 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7f435422-0031-45ef-990e-cad7c31f19ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:27.509166 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7f435422-0031-45ef-990e-cad7c31f19ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:27.509615 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7f435422-0031-45ef-990e-cad7c31f19ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:27.510379 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7f435422-0031-45ef-990e-cad7c31f19ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:27.510815 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7f435422-0031-45ef-990e-cad7c31f19ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:27.640345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7f435422-0031-45ef-990e-cad7c31f19ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:27.647616 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7f435422-0031-45ef-990e-cad7c31f19ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.148753 Jul 19 09:31:27.648193 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 414/802] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:27 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:28.352194 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e6929404-7e31-4784-a435-cc3ca41c7f65 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:28.352767 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e6929404-7e31-4784-a435-cc3ca41c7f65 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:28.359332 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e6929404-7e31-4784-a435-cc3ca41c7f65 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:28.359783 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e6929404-7e31-4784-a435-cc3ca41c7f65 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:28.360547 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e6929404-7e31-4784-a435-cc3ca41c7f65 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:28.360991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e6929404-7e31-4784-a435-cc3ca41c7f65 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:28.489961 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e6929404-7e31-4784-a435-cc3ca41c7f65 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:28.498682 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e6929404-7e31-4784-a435-cc3ca41c7f65 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:28.500213 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e6929404-7e31-4784-a435-cc3ca41c7f65 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:28.501340 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e6929404-7e31-4784-a435-cc3ca41c7f65 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153017 Jul 19 09:31:28.501898 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 389/803] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:28 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:28.664779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f3dceee0-d049-4b6f-866f-436d62c8c05c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:28.665647 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f3dceee0-d049-4b6f-866f-436d62c8c05c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:28.671515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f3dceee0-d049-4b6f-866f-436d62c8c05c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:28.671954 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f3dceee0-d049-4b6f-866f-436d62c8c05c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:28.672708 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f3dceee0-d049-4b6f-866f-436d62c8c05c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:28.673138 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f3dceee0-d049-4b6f-866f-436d62c8c05c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:28.805947 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f3dceee0-d049-4b6f-866f-436d62c8c05c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:28.813678 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f3dceee0-d049-4b6f-866f-436d62c8c05c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152947 Jul 19 09:31:28.814234 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 415/804] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:28 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:29.519932 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-23acc1a4-0e4e-4863-90a7-667e7fb3a6b7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:29.520475 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-23acc1a4-0e4e-4863-90a7-667e7fb3a6b7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:29.526822 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-23acc1a4-0e4e-4863-90a7-667e7fb3a6b7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:29.527368 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-23acc1a4-0e4e-4863-90a7-667e7fb3a6b7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:29.528134 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-23acc1a4-0e4e-4863-90a7-667e7fb3a6b7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:29.528567 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-23acc1a4-0e4e-4863-90a7-667e7fb3a6b7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:29.662710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-23acc1a4-0e4e-4863-90a7-667e7fb3a6b7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:29.671695 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-23acc1a4-0e4e-4863-90a7-667e7fb3a6b7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:29.673197 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-23acc1a4-0e4e-4863-90a7-667e7fb3a6b7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:29.674322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-23acc1a4-0e4e-4863-90a7-667e7fb3a6b7 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.158203 Jul 19 09:31:29.674873 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 390/805] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:29 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:29.830206 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ce03d773-b1b9-4500-9a79-384bc81e102d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:29.830748 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ce03d773-b1b9-4500-9a79-384bc81e102d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:29.836505 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ce03d773-b1b9-4500-9a79-384bc81e102d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:29.836960 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ce03d773-b1b9-4500-9a79-384bc81e102d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:29.838217 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ce03d773-b1b9-4500-9a79-384bc81e102d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:29.838657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ce03d773-b1b9-4500-9a79-384bc81e102d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:29.968213 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ce03d773-b1b9-4500-9a79-384bc81e102d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:29.975415 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ce03d773-b1b9-4500-9a79-384bc81e102d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.148795 Jul 19 09:31:29.975985 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 416/806] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:29 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:30.692719 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9d165b86-5170-427b-887f-df735afb5231 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:30.693355 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9d165b86-5170-427b-887f-df735afb5231 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:30.699133 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d165b86-5170-427b-887f-df735afb5231 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:30.699584 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d165b86-5170-427b-887f-df735afb5231 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:30.700345 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d165b86-5170-427b-887f-df735afb5231 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:30.700776 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d165b86-5170-427b-887f-df735afb5231 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:30.832175 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9d165b86-5170-427b-887f-df735afb5231 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:30.840283 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9d165b86-5170-427b-887f-df735afb5231 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:30.841793 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9d165b86-5170-427b-887f-df735afb5231 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:30.842921 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9d165b86-5170-427b-887f-df735afb5231 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153964 Jul 19 09:31:30.843534 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 391/807] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:30 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:30.992492 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0c6556da-caed-4b02-b504-d58c99220662 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:30.993089 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0c6556da-caed-4b02-b504-d58c99220662 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:30.999370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0c6556da-caed-4b02-b504-d58c99220662 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:30.999854 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0c6556da-caed-4b02-b504-d58c99220662 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:31.000639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0c6556da-caed-4b02-b504-d58c99220662 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:31.001067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0c6556da-caed-4b02-b504-d58c99220662 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:31.131789 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0c6556da-caed-4b02-b504-d58c99220662 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:31.139917 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0c6556da-caed-4b02-b504-d58c99220662 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.151004 Jul 19 09:31:31.140486 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 417/808] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:30 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:31.860373 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bc3e4ccf-b066-4f0d-b109-116a5361af45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:31.860982 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bc3e4ccf-b066-4f0d-b109-116a5361af45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:31.866824 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc3e4ccf-b066-4f0d-b109-116a5361af45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:31.867314 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc3e4ccf-b066-4f0d-b109-116a5361af45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:31.868080 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc3e4ccf-b066-4f0d-b109-116a5361af45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:31.868526 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc3e4ccf-b066-4f0d-b109-116a5361af45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:32.001977 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bc3e4ccf-b066-4f0d-b109-116a5361af45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:32.010514 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bc3e4ccf-b066-4f0d-b109-116a5361af45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:32.012036 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bc3e4ccf-b066-4f0d-b109-116a5361af45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:32.013163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bc3e4ccf-b066-4f0d-b109-116a5361af45 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156534 Jul 19 09:31:32.013712 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 392/809] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:31 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:32.156813 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0f201c85-2155-427a-bdb0-58056756afed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:32.157344 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0f201c85-2155-427a-bdb0-58056756afed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:32.163132 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0f201c85-2155-427a-bdb0-58056756afed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:32.163586 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0f201c85-2155-427a-bdb0-58056756afed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:32.164354 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0f201c85-2155-427a-bdb0-58056756afed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:32.164796 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0f201c85-2155-427a-bdb0-58056756afed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:32.296171 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0f201c85-2155-427a-bdb0-58056756afed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:32.303410 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0f201c85-2155-427a-bdb0-58056756afed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.150323 Jul 19 09:31:32.303982 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 418/810] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:32 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:33.031646 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-12fd9520-d2cd-4578-b3ca-09e784c646b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:33.032246 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-12fd9520-d2cd-4578-b3ca-09e784c646b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:33.037969 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12fd9520-d2cd-4578-b3ca-09e784c646b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:33.038412 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12fd9520-d2cd-4578-b3ca-09e784c646b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:33.039555 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12fd9520-d2cd-4578-b3ca-09e784c646b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:33.040241 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12fd9520-d2cd-4578-b3ca-09e784c646b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:33.199205 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-12fd9520-d2cd-4578-b3ca-09e784c646b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:33.209711 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-12fd9520-d2cd-4578-b3ca-09e784c646b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:33.212292 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-12fd9520-d2cd-4578-b3ca-09e784c646b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:33.214043 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-12fd9520-d2cd-4578-b3ca-09e784c646b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.186102 Jul 19 09:31:33.214603 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 393/811] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:33 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:33.320457 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f8079c69-9b30-4ba3-ba08-e471e398a2da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:33.321339 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f8079c69-9b30-4ba3-ba08-e471e398a2da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:33.330004 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f8079c69-9b30-4ba3-ba08-e471e398a2da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:33.332248 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f8079c69-9b30-4ba3-ba08-e471e398a2da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:33.333764 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f8079c69-9b30-4ba3-ba08-e471e398a2da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:33.334435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f8079c69-9b30-4ba3-ba08-e471e398a2da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:33.477323 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f8079c69-9b30-4ba3-ba08-e471e398a2da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:33.486838 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f8079c69-9b30-4ba3-ba08-e471e398a2da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.169613 Jul 19 09:31:33.488013 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 419/812] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:33 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:34.232114 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e0c5d8ff-0961-4998-9100-c203ea889201 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:34.232713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e0c5d8ff-0961-4998-9100-c203ea889201 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:34.238460 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e0c5d8ff-0961-4998-9100-c203ea889201 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:34.238899 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e0c5d8ff-0961-4998-9100-c203ea889201 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:34.239677 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e0c5d8ff-0961-4998-9100-c203ea889201 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:34.240102 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e0c5d8ff-0961-4998-9100-c203ea889201 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:34.373376 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e0c5d8ff-0961-4998-9100-c203ea889201 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:34.381482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e0c5d8ff-0961-4998-9100-c203ea889201 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:34.383000 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e0c5d8ff-0961-4998-9100-c203ea889201 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:34.384166 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e0c5d8ff-0961-4998-9100-c203ea889201 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156219 Jul 19 09:31:34.384716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 394/813] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:34 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:34.504198 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a13cf606-a13b-467b-8cf6-d7b97a95ba53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:34.504792 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a13cf606-a13b-467b-8cf6-d7b97a95ba53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:34.511019 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a13cf606-a13b-467b-8cf6-d7b97a95ba53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:34.511493 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a13cf606-a13b-467b-8cf6-d7b97a95ba53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:34.512238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a13cf606-a13b-467b-8cf6-d7b97a95ba53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:34.512669 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a13cf606-a13b-467b-8cf6-d7b97a95ba53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:34.644821 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a13cf606-a13b-467b-8cf6-d7b97a95ba53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:34.652072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a13cf606-a13b-467b-8cf6-d7b97a95ba53 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.151471 Jul 19 09:31:34.652631 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 420/814] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:34 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:35.402330 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-dffeba19-05aa-4251-9622-ee1787349193 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:35.402940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-dffeba19-05aa-4251-9622-ee1787349193 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:35.408828 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dffeba19-05aa-4251-9622-ee1787349193 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:35.409280 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dffeba19-05aa-4251-9622-ee1787349193 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:35.410063 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dffeba19-05aa-4251-9622-ee1787349193 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:35.410504 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dffeba19-05aa-4251-9622-ee1787349193 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:35.539449 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-dffeba19-05aa-4251-9622-ee1787349193 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:35.548253 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-dffeba19-05aa-4251-9622-ee1787349193 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:35.549760 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-dffeba19-05aa-4251-9622-ee1787349193 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:35.550897 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-dffeba19-05aa-4251-9622-ee1787349193 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.152308 Jul 19 09:31:35.551488 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 395/815] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:35 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:35.669300 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ee461a70-31b8-45ed-9986-de3815b2c1bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:35.669897 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ee461a70-31b8-45ed-9986-de3815b2c1bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:35.675546 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ee461a70-31b8-45ed-9986-de3815b2c1bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:35.675988 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ee461a70-31b8-45ed-9986-de3815b2c1bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:35.676757 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ee461a70-31b8-45ed-9986-de3815b2c1bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:35.677168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ee461a70-31b8-45ed-9986-de3815b2c1bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:35.804771 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ee461a70-31b8-45ed-9986-de3815b2c1bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:35.812015 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ee461a70-31b8-45ed-9986-de3815b2c1bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.147109 Jul 19 09:31:35.812582 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 421/816] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:35 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:36.568973 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f712cba2-b219-4fd3-9627-b0ed90036370 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:36.569523 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f712cba2-b219-4fd3-9627-b0ed90036370 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:36.575329 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f712cba2-b219-4fd3-9627-b0ed90036370 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:36.575777 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f712cba2-b219-4fd3-9627-b0ed90036370 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:36.576540 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f712cba2-b219-4fd3-9627-b0ed90036370 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:36.576977 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f712cba2-b219-4fd3-9627-b0ed90036370 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:36.709584 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f712cba2-b219-4fd3-9627-b0ed90036370 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:36.717627 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f712cba2-b219-4fd3-9627-b0ed90036370 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:36.719161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f712cba2-b219-4fd3-9627-b0ed90036370 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:36.720293 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f712cba2-b219-4fd3-9627-b0ed90036370 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.155100 Jul 19 09:31:36.720857 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 396/817] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:36 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:31:36.828553 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-36a1e765-60ed-42c2-99d3-b3b3548bf66b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:36.829088 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-36a1e765-60ed-42c2-99d3-b3b3548bf66b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:36.835015 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-36a1e765-60ed-42c2-99d3-b3b3548bf66b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:36.835605 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-36a1e765-60ed-42c2-99d3-b3b3548bf66b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:36.836302 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-36a1e765-60ed-42c2-99d3-b3b3548bf66b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:36.836739 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-36a1e765-60ed-42c2-99d3-b3b3548bf66b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:36.966219 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-36a1e765-60ed-42c2-99d3-b3b3548bf66b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:36.973657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-36a1e765-60ed-42c2-99d3-b3b3548bf66b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.148795 Jul 19 09:31:36.974222 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 422/818] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:36 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:37.737739 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4d03bd0f-9559-49cd-a299-56039242ff17 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:37.738280 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4d03bd0f-9559-49cd-a299-56039242ff17 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:37.744498 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4d03bd0f-9559-49cd-a299-56039242ff17 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:37.744943 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4d03bd0f-9559-49cd-a299-56039242ff17 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:37.745701 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4d03bd0f-9559-49cd-a299-56039242ff17 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:37.746133 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4d03bd0f-9559-49cd-a299-56039242ff17 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:37.874335 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4d03bd0f-9559-49cd-a299-56039242ff17 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:37.882495 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4d03bd0f-9559-49cd-a299-56039242ff17 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:37.884026 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4d03bd0f-9559-49cd-a299-56039242ff17 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:37.885155 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4d03bd0f-9559-49cd-a299-56039242ff17 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.151189 Jul 19 09:31:37.885715 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 397/819] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:37 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:37.990613 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f4555b9c-2871-458b-8721-c00249bb5b24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:37.991164 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f4555b9c-2871-458b-8721-c00249bb5b24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:37.997532 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4555b9c-2871-458b-8721-c00249bb5b24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:37.997973 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4555b9c-2871-458b-8721-c00249bb5b24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:37.998718 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4555b9c-2871-458b-8721-c00249bb5b24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:37.999175 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4555b9c-2871-458b-8721-c00249bb5b24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:38.131002 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f4555b9c-2871-458b-8721-c00249bb5b24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:38.138683 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f4555b9c-2871-458b-8721-c00249bb5b24 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.151713 Jul 19 09:31:38.139289 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 423/820] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:37 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:38.903156 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-04f4e8c5-30aa-4198-af1c-5cd8a3edf0d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:38.903762 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-04f4e8c5-30aa-4198-af1c-5cd8a3edf0d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:38.909546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-04f4e8c5-30aa-4198-af1c-5cd8a3edf0d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:38.909984 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-04f4e8c5-30aa-4198-af1c-5cd8a3edf0d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:38.910739 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-04f4e8c5-30aa-4198-af1c-5cd8a3edf0d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:38.911188 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-04f4e8c5-30aa-4198-af1c-5cd8a3edf0d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:39.039857 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-04f4e8c5-30aa-4198-af1c-5cd8a3edf0d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:39.048963 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-04f4e8c5-30aa-4198-af1c-5cd8a3edf0d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:39.050480 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-04f4e8c5-30aa-4198-af1c-5cd8a3edf0d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:39.051646 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-04f4e8c5-30aa-4198-af1c-5cd8a3edf0d4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.152271 Jul 19 09:31:39.052207 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 398/821] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:38 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:39.155641 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-67fc636d-b645-45f6-a217-28ba9dd657ad tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:39.156173 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-67fc636d-b645-45f6-a217-28ba9dd657ad tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:39.161901 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67fc636d-b645-45f6-a217-28ba9dd657ad tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:39.162351 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67fc636d-b645-45f6-a217-28ba9dd657ad tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:39.163130 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67fc636d-b645-45f6-a217-28ba9dd657ad tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:39.163558 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67fc636d-b645-45f6-a217-28ba9dd657ad tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:39.291871 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-67fc636d-b645-45f6-a217-28ba9dd657ad tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:39.298922 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-67fc636d-b645-45f6-a217-28ba9dd657ad tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.146994 Jul 19 09:31:39.299516 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 424/822] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:39 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:40.068644 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-35a43c83-6ce8-4e8e-a60d-87df88dd25a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:40.069254 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-35a43c83-6ce8-4e8e-a60d-87df88dd25a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:40.075552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-35a43c83-6ce8-4e8e-a60d-87df88dd25a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:40.076005 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-35a43c83-6ce8-4e8e-a60d-87df88dd25a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:40.076764 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-35a43c83-6ce8-4e8e-a60d-87df88dd25a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:40.077195 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-35a43c83-6ce8-4e8e-a60d-87df88dd25a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:40.209872 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-35a43c83-6ce8-4e8e-a60d-87df88dd25a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:40.218538 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-35a43c83-6ce8-4e8e-a60d-87df88dd25a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:40.220084 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-35a43c83-6ce8-4e8e-a60d-87df88dd25a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:40.221221 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-35a43c83-6ce8-4e8e-a60d-87df88dd25a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156316 Jul 19 09:31:40.221777 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 399/823] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:40 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:31:40.315914 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f743c0d1-860d-4250-8474-f487ffa96a07 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:40.316524 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f743c0d1-860d-4250-8474-f487ffa96a07 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:40.322855 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f743c0d1-860d-4250-8474-f487ffa96a07 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:40.323297 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f743c0d1-860d-4250-8474-f487ffa96a07 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:40.324059 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f743c0d1-860d-4250-8474-f487ffa96a07 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:40.324495 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f743c0d1-860d-4250-8474-f487ffa96a07 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:40.454837 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f743c0d1-860d-4250-8474-f487ffa96a07 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:40.462080 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f743c0d1-860d-4250-8474-f487ffa96a07 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.149787 Jul 19 09:31:40.462647 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 425/824] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:40 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:41.238886 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-caad701e-5868-4b13-86e5-bafd9bfe558e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:41.239585 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-caad701e-5868-4b13-86e5-bafd9bfe558e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:41.245354 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-caad701e-5868-4b13-86e5-bafd9bfe558e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:41.245799 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-caad701e-5868-4b13-86e5-bafd9bfe558e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:41.246549 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-caad701e-5868-4b13-86e5-bafd9bfe558e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:41.246977 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-caad701e-5868-4b13-86e5-bafd9bfe558e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:41.376841 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-caad701e-5868-4b13-86e5-bafd9bfe558e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:41.385569 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-caad701e-5868-4b13-86e5-bafd9bfe558e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:41.387143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-caad701e-5868-4b13-86e5-bafd9bfe558e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:41.388314 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-caad701e-5868-4b13-86e5-bafd9bfe558e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153251 Jul 19 09:31:41.388874 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 400/825] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:41 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:41.479220 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1bb94cf6-1ab0-4041-bb64-e93ee5885b39 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:41.479784 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1bb94cf6-1ab0-4041-bb64-e93ee5885b39 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:41.485542 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1bb94cf6-1ab0-4041-bb64-e93ee5885b39 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:41.485989 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1bb94cf6-1ab0-4041-bb64-e93ee5885b39 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:41.486747 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1bb94cf6-1ab0-4041-bb64-e93ee5885b39 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:41.487209 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1bb94cf6-1ab0-4041-bb64-e93ee5885b39 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:41.615385 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1bb94cf6-1ab0-4041-bb64-e93ee5885b39 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:41.623218 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1bb94cf6-1ab0-4041-bb64-e93ee5885b39 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.148149 Jul 19 09:31:41.623785 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 426/826] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:41 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:42.406347 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-08e746cd-ccac-4f8b-8ade-e3d35c6a4872 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:42.406899 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-08e746cd-ccac-4f8b-8ade-e3d35c6a4872 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:42.412523 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08e746cd-ccac-4f8b-8ade-e3d35c6a4872 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:42.412961 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08e746cd-ccac-4f8b-8ade-e3d35c6a4872 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:42.413714 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08e746cd-ccac-4f8b-8ade-e3d35c6a4872 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:42.414148 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08e746cd-ccac-4f8b-8ade-e3d35c6a4872 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:42.550883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-08e746cd-ccac-4f8b-8ade-e3d35c6a4872 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:42.559451 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-08e746cd-ccac-4f8b-8ade-e3d35c6a4872 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:42.560933 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-08e746cd-ccac-4f8b-8ade-e3d35c6a4872 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:42.562049 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-08e746cd-ccac-4f8b-8ade-e3d35c6a4872 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.159647 Jul 19 09:31:42.562606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 401/827] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:42 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:42.640281 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-966de0a3-33f0-427c-b992-b7acfaa29197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:42.640876 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-966de0a3-33f0-427c-b992-b7acfaa29197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:42.646444 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-966de0a3-33f0-427c-b992-b7acfaa29197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:42.646881 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-966de0a3-33f0-427c-b992-b7acfaa29197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:42.647660 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-966de0a3-33f0-427c-b992-b7acfaa29197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:42.648084 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-966de0a3-33f0-427c-b992-b7acfaa29197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:42.776022 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-966de0a3-33f0-427c-b992-b7acfaa29197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:42.783060 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-966de0a3-33f0-427c-b992-b7acfaa29197 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.146364 Jul 19 09:31:42.783619 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 427/828] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:42 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:43.579906 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-00b0f491-d818-495b-99a3-4c056af9317e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:43.580417 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-00b0f491-d818-495b-99a3-4c056af9317e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:43.586214 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-00b0f491-d818-495b-99a3-4c056af9317e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:43.586654 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-00b0f491-d818-495b-99a3-4c056af9317e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:43.587934 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-00b0f491-d818-495b-99a3-4c056af9317e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:43.588368 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-00b0f491-d818-495b-99a3-4c056af9317e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:43.717765 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-00b0f491-d818-495b-99a3-4c056af9317e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:43.725747 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-00b0f491-d818-495b-99a3-4c056af9317e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:43.727269 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-00b0f491-d818-495b-99a3-4c056af9317e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:43.728388 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-00b0f491-d818-495b-99a3-4c056af9317e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.152257 Jul 19 09:31:43.728936 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 402/829] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:43 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:43.799750 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-fb322b15-cb82-43d2-b4fc-365cafd55d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:43.800341 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-fb322b15-cb82-43d2-b4fc-365cafd55d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:43.805973 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fb322b15-cb82-43d2-b4fc-365cafd55d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:43.806414 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fb322b15-cb82-43d2-b4fc-365cafd55d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:43.807190 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fb322b15-cb82-43d2-b4fc-365cafd55d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:43.807620 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fb322b15-cb82-43d2-b4fc-365cafd55d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:43.938354 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-fb322b15-cb82-43d2-b4fc-365cafd55d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:43.945711 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-fb322b15-cb82-43d2-b4fc-365cafd55d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.149513 Jul 19 09:31:43.946779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 428/830] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:43 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:44.746091 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-97b45718-47c5-4e35-ab89-2e5474a5e498 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:44.746698 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-97b45718-47c5-4e35-ab89-2e5474a5e498 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:44.752504 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97b45718-47c5-4e35-ab89-2e5474a5e498 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:44.752950 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97b45718-47c5-4e35-ab89-2e5474a5e498 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:44.753709 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97b45718-47c5-4e35-ab89-2e5474a5e498 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:44.754140 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97b45718-47c5-4e35-ab89-2e5474a5e498 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:44.888592 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-97b45718-47c5-4e35-ab89-2e5474a5e498 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:44.896716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-97b45718-47c5-4e35-ab89-2e5474a5e498 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:44.898219 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-97b45718-47c5-4e35-ab89-2e5474a5e498 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:44.899950 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-97b45718-47c5-4e35-ab89-2e5474a5e498 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.157601 Jul 19 09:31:44.900515 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 403/831] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:44 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:44.963481 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e02652fc-7640-401f-b22f-bad3f39d79e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:44.964079 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e02652fc-7640-401f-b22f-bad3f39d79e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:44.969823 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e02652fc-7640-401f-b22f-bad3f39d79e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:44.970267 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e02652fc-7640-401f-b22f-bad3f39d79e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:44.971019 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e02652fc-7640-401f-b22f-bad3f39d79e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:44.971470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e02652fc-7640-401f-b22f-bad3f39d79e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:45.100747 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e02652fc-7640-401f-b22f-bad3f39d79e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:45.108134 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e02652fc-7640-401f-b22f-bad3f39d79e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.149016 Jul 19 09:31:45.108692 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 429/832] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:44 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:45.918554 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-272472cc-d500-43e7-9244-8f0cebf0de09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:45.919172 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-272472cc-d500-43e7-9244-8f0cebf0de09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:45.924907 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-272472cc-d500-43e7-9244-8f0cebf0de09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:45.925354 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-272472cc-d500-43e7-9244-8f0cebf0de09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:45.926105 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-272472cc-d500-43e7-9244-8f0cebf0de09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:45.926531 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-272472cc-d500-43e7-9244-8f0cebf0de09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:46.057894 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-272472cc-d500-43e7-9244-8f0cebf0de09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:46.065879 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-272472cc-d500-43e7-9244-8f0cebf0de09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:46.067404 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-272472cc-d500-43e7-9244-8f0cebf0de09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:46.068526 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-272472cc-d500-43e7-9244-8f0cebf0de09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154570 Jul 19 09:31:46.069080 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 404/833] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:45 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:46.124679 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f9bc540d-a5ad-4b8f-8419-acd9eeab647b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:46.125290 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f9bc540d-a5ad-4b8f-8419-acd9eeab647b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:46.131082 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9bc540d-a5ad-4b8f-8419-acd9eeab647b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:46.131540 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9bc540d-a5ad-4b8f-8419-acd9eeab647b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:46.132304 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9bc540d-a5ad-4b8f-8419-acd9eeab647b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:46.132738 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9bc540d-a5ad-4b8f-8419-acd9eeab647b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:46.266293 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f9bc540d-a5ad-4b8f-8419-acd9eeab647b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:46.273742 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f9bc540d-a5ad-4b8f-8419-acd9eeab647b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152507 Jul 19 09:31:46.274906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 430/834] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:46 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:47.086918 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0f3f66eb-5364-4eaf-8ec5-7e4464d8bc55 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:47.087567 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0f3f66eb-5364-4eaf-8ec5-7e4464d8bc55 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:47.093322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0f3f66eb-5364-4eaf-8ec5-7e4464d8bc55 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:47.093768 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0f3f66eb-5364-4eaf-8ec5-7e4464d8bc55 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:47.094523 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0f3f66eb-5364-4eaf-8ec5-7e4464d8bc55 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:47.094951 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0f3f66eb-5364-4eaf-8ec5-7e4464d8bc55 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:47.224092 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0f3f66eb-5364-4eaf-8ec5-7e4464d8bc55 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:47.232112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0f3f66eb-5364-4eaf-8ec5-7e4464d8bc55 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:47.233592 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0f3f66eb-5364-4eaf-8ec5-7e4464d8bc55 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:47.234709 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0f3f66eb-5364-4eaf-8ec5-7e4464d8bc55 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.151498 Jul 19 09:31:47.235306 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 405/835] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:47 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:47.290833 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3fee36d1-1314-4188-84fb-390cf8fb8dcb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:47.291462 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3fee36d1-1314-4188-84fb-390cf8fb8dcb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:47.297096 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3fee36d1-1314-4188-84fb-390cf8fb8dcb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:47.297542 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3fee36d1-1314-4188-84fb-390cf8fb8dcb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:47.298298 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3fee36d1-1314-4188-84fb-390cf8fb8dcb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:47.298728 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3fee36d1-1314-4188-84fb-390cf8fb8dcb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:47.427822 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3fee36d1-1314-4188-84fb-390cf8fb8dcb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:47.435483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3fee36d1-1314-4188-84fb-390cf8fb8dcb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.148479 Jul 19 09:31:47.436044 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 431/836] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:47 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:48.253175 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a76e163e-67bf-45ee-b775-87dcd4750e8e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:48.253783 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a76e163e-67bf-45ee-b775-87dcd4750e8e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:48.260127 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a76e163e-67bf-45ee-b775-87dcd4750e8e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:48.260569 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a76e163e-67bf-45ee-b775-87dcd4750e8e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:48.261317 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a76e163e-67bf-45ee-b775-87dcd4750e8e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:48.261751 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a76e163e-67bf-45ee-b775-87dcd4750e8e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:48.392946 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a76e163e-67bf-45ee-b775-87dcd4750e8e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:48.401610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a76e163e-67bf-45ee-b775-87dcd4750e8e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:48.403130 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a76e163e-67bf-45ee-b775-87dcd4750e8e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:48.404245 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a76e163e-67bf-45ee-b775-87dcd4750e8e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154834 Jul 19 09:31:48.404795 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 406/837] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:48 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:48.452660 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-49a114ef-3eea-4f6d-b5a0-c9203c223b8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:48.453268 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-49a114ef-3eea-4f6d-b5a0-c9203c223b8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:48.458989 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49a114ef-3eea-4f6d-b5a0-c9203c223b8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:48.459472 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49a114ef-3eea-4f6d-b5a0-c9203c223b8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:48.460264 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49a114ef-3eea-4f6d-b5a0-c9203c223b8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:48.460701 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49a114ef-3eea-4f6d-b5a0-c9203c223b8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:48.588063 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-49a114ef-3eea-4f6d-b5a0-c9203c223b8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:48.595272 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-49a114ef-3eea-4f6d-b5a0-c9203c223b8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.146272 Jul 19 09:31:48.595831 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 432/838] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:48 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:49.421787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-568c4cf9-bca7-4456-81fa-92a8b26b9e48 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:49.422326 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-568c4cf9-bca7-4456-81fa-92a8b26b9e48 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:49.428158 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-568c4cf9-bca7-4456-81fa-92a8b26b9e48 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:49.428630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-568c4cf9-bca7-4456-81fa-92a8b26b9e48 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:49.429390 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-568c4cf9-bca7-4456-81fa-92a8b26b9e48 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:49.429825 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-568c4cf9-bca7-4456-81fa-92a8b26b9e48 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:49.560637 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-568c4cf9-bca7-4456-81fa-92a8b26b9e48 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:49.568730 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-568c4cf9-bca7-4456-81fa-92a8b26b9e48 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:49.570234 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-568c4cf9-bca7-4456-81fa-92a8b26b9e48 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:49.571429 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-568c4cf9-bca7-4456-81fa-92a8b26b9e48 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153407 Jul 19 09:31:49.571998 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 407/839] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:49 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:49.611655 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bd1c1477-f0da-40bf-ac9c-0f1d0064e831 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:49.612255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bd1c1477-f0da-40bf-ac9c-0f1d0064e831 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:49.617894 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bd1c1477-f0da-40bf-ac9c-0f1d0064e831 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:49.618336 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bd1c1477-f0da-40bf-ac9c-0f1d0064e831 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:49.619113 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bd1c1477-f0da-40bf-ac9c-0f1d0064e831 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:49.619543 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bd1c1477-f0da-40bf-ac9c-0f1d0064e831 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:49.750675 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bd1c1477-f0da-40bf-ac9c-0f1d0064e831 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:49.757809 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bd1c1477-f0da-40bf-ac9c-0f1d0064e831 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.149791 Jul 19 09:31:49.758375 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 433/840] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:49 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:50.589795 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9bbef9ff-aaae-4fb9-aec5-e5e382d3a32e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:50.590398 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9bbef9ff-aaae-4fb9-aec5-e5e382d3a32e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:50.596252 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9bbef9ff-aaae-4fb9-aec5-e5e382d3a32e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:50.596701 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9bbef9ff-aaae-4fb9-aec5-e5e382d3a32e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:50.597458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9bbef9ff-aaae-4fb9-aec5-e5e382d3a32e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:50.597893 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9bbef9ff-aaae-4fb9-aec5-e5e382d3a32e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:50.725351 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9bbef9ff-aaae-4fb9-aec5-e5e382d3a32e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:50.733430 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9bbef9ff-aaae-4fb9-aec5-e5e382d3a32e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:50.734927 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9bbef9ff-aaae-4fb9-aec5-e5e382d3a32e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:50.736083 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9bbef9ff-aaae-4fb9-aec5-e5e382d3a32e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.150553 Jul 19 09:31:50.736637 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 408/841] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:50 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:50.775650 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-afbd2855-45af-4827-ad3e-f61eb7b376e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:50.776251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-afbd2855-45af-4827-ad3e-f61eb7b376e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:50.781849 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-afbd2855-45af-4827-ad3e-f61eb7b376e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:50.782291 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-afbd2855-45af-4827-ad3e-f61eb7b376e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:50.783062 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-afbd2855-45af-4827-ad3e-f61eb7b376e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:50.783492 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-afbd2855-45af-4827-ad3e-f61eb7b376e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:50.911200 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-afbd2855-45af-4827-ad3e-f61eb7b376e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:50.918912 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-afbd2855-45af-4827-ad3e-f61eb7b376e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.147446 Jul 19 09:31:50.919493 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 434/842] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:50 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:51.753576 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9eee903c-f91e-4840-b688-63249033adfb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:51.754180 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9eee903c-f91e-4840-b688-63249033adfb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:51.760522 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9eee903c-f91e-4840-b688-63249033adfb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:51.760966 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9eee903c-f91e-4840-b688-63249033adfb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:51.761728 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9eee903c-f91e-4840-b688-63249033adfb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:51.762153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9eee903c-f91e-4840-b688-63249033adfb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:51.893441 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9eee903c-f91e-4840-b688-63249033adfb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:51.901530 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9eee903c-f91e-4840-b688-63249033adfb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:51.903012 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9eee903c-f91e-4840-b688-63249033adfb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:51.904167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9eee903c-f91e-4840-b688-63249033adfb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154272 Jul 19 09:31:51.904708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 409/843] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:51 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:51.935352 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-acc4096b-9c26-400e-b8f0-c33044c6f6c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:51.935957 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-acc4096b-9c26-400e-b8f0-c33044c6f6c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:51.941588 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-acc4096b-9c26-400e-b8f0-c33044c6f6c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:51.942040 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-acc4096b-9c26-400e-b8f0-c33044c6f6c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:51.942795 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-acc4096b-9c26-400e-b8f0-c33044c6f6c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:51.943253 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-acc4096b-9c26-400e-b8f0-c33044c6f6c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:52.074169 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-acc4096b-9c26-400e-b8f0-c33044c6f6c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:52.081331 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-acc4096b-9c26-400e-b8f0-c33044c6f6c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.149634 Jul 19 09:31:52.081894 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 435/844] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:51 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:52.922751 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9e32b24d-b0a3-4f8f-9c5e-e42d920cc30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:52.923382 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9e32b24d-b0a3-4f8f-9c5e-e42d920cc30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:52.929254 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9e32b24d-b0a3-4f8f-9c5e-e42d920cc30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:52.929703 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9e32b24d-b0a3-4f8f-9c5e-e42d920cc30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:52.931069 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9e32b24d-b0a3-4f8f-9c5e-e42d920cc30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:52.931510 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9e32b24d-b0a3-4f8f-9c5e-e42d920cc30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:53.061894 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9e32b24d-b0a3-4f8f-9c5e-e42d920cc30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:53.069980 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9e32b24d-b0a3-4f8f-9c5e-e42d920cc30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:53.072135 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9e32b24d-b0a3-4f8f-9c5e-e42d920cc30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:53.073261 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9e32b24d-b0a3-4f8f-9c5e-e42d920cc30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154280 Jul 19 09:31:53.073821 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 410/845] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:52 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:53.098012 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-626c4517-6188-41dd-8ef4-3f0e85e79f6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:53.098619 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-626c4517-6188-41dd-8ef4-3f0e85e79f6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:53.104281 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-626c4517-6188-41dd-8ef4-3f0e85e79f6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:53.104722 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-626c4517-6188-41dd-8ef4-3f0e85e79f6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:53.105476 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-626c4517-6188-41dd-8ef4-3f0e85e79f6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:53.105904 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-626c4517-6188-41dd-8ef4-3f0e85e79f6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:53.235327 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-626c4517-6188-41dd-8ef4-3f0e85e79f6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:53.242465 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-626c4517-6188-41dd-8ef4-3f0e85e79f6b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.148132 Jul 19 09:31:53.243557 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 436/846] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:53 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:54.091822 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5c3df12d-7000-4750-9aac-a9609eb0c74c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:54.092464 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5c3df12d-7000-4750-9aac-a9609eb0c74c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:54.098214 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c3df12d-7000-4750-9aac-a9609eb0c74c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:54.098664 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c3df12d-7000-4750-9aac-a9609eb0c74c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:54.099463 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c3df12d-7000-4750-9aac-a9609eb0c74c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:54.099897 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c3df12d-7000-4750-9aac-a9609eb0c74c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:54.234519 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5c3df12d-7000-4750-9aac-a9609eb0c74c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:54.242647 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5c3df12d-7000-4750-9aac-a9609eb0c74c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:54.244175 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5c3df12d-7000-4750-9aac-a9609eb0c74c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:54.245301 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5c3df12d-7000-4750-9aac-a9609eb0c74c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.157365 Jul 19 09:31:54.245861 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 411/847] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:54 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:54.259925 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0e6c93bd-4b01-4131-ac06-5d9d2bd68905 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:54.260531 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0e6c93bd-4b01-4131-ac06-5d9d2bd68905 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:54.266210 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0e6c93bd-4b01-4131-ac06-5d9d2bd68905 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:54.266652 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0e6c93bd-4b01-4131-ac06-5d9d2bd68905 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:54.267438 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0e6c93bd-4b01-4131-ac06-5d9d2bd68905 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:54.267869 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0e6c93bd-4b01-4131-ac06-5d9d2bd68905 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:54.396506 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0e6c93bd-4b01-4131-ac06-5d9d2bd68905 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:54.404232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0e6c93bd-4b01-4131-ac06-5d9d2bd68905 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.148450 Jul 19 09:31:54.404798 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 437/848] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:54 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:55.263507 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-478c7b36-95ce-4017-8cd8-8aaaec02cee1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:55.264109 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-478c7b36-95ce-4017-8cd8-8aaaec02cee1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:55.270061 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-478c7b36-95ce-4017-8cd8-8aaaec02cee1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:55.270518 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-478c7b36-95ce-4017-8cd8-8aaaec02cee1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:55.271243 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-478c7b36-95ce-4017-8cd8-8aaaec02cee1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:55.271670 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-478c7b36-95ce-4017-8cd8-8aaaec02cee1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:55.402808 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-478c7b36-95ce-4017-8cd8-8aaaec02cee1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:55.410827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-478c7b36-95ce-4017-8cd8-8aaaec02cee1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:55.412356 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-478c7b36-95ce-4017-8cd8-8aaaec02cee1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:55.413481 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-478c7b36-95ce-4017-8cd8-8aaaec02cee1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153596 Jul 19 09:31:55.414033 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 412/849] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:55 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:55.421331 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-77609ff6-c752-417a-a11f-b9e92d4ebc9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:55.421944 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-77609ff6-c752-417a-a11f-b9e92d4ebc9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:55.427746 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-77609ff6-c752-417a-a11f-b9e92d4ebc9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:55.428216 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-77609ff6-c752-417a-a11f-b9e92d4ebc9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:55.428993 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-77609ff6-c752-417a-a11f-b9e92d4ebc9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:55.429417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-77609ff6-c752-417a-a11f-b9e92d4ebc9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:55.561741 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-77609ff6-c752-417a-a11f-b9e92d4ebc9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:55.568923 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-77609ff6-c752-417a-a11f-b9e92d4ebc9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.151388 Jul 19 09:31:55.569488 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 438/850] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:55 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:31:56.431897 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8dfbf389-d166-4df3-8efe-82ede143687d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:56.432502 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8dfbf389-d166-4df3-8efe-82ede143687d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:56.438292 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8dfbf389-d166-4df3-8efe-82ede143687d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:56.438742 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8dfbf389-d166-4df3-8efe-82ede143687d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:56.439610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8dfbf389-d166-4df3-8efe-82ede143687d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:56.440042 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8dfbf389-d166-4df3-8efe-82ede143687d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:56.568997 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8dfbf389-d166-4df3-8efe-82ede143687d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:56.577567 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8dfbf389-d166-4df3-8efe-82ede143687d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:56.579095 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8dfbf389-d166-4df3-8efe-82ede143687d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:56.580230 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8dfbf389-d166-4df3-8efe-82ede143687d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.152139 Jul 19 09:31:56.580784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 413/851] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:56 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:56.585276 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-596cc5fb-d046-47be-aa47-f04e421235de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:56.585879 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-596cc5fb-d046-47be-aa47-f04e421235de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:56.592088 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-596cc5fb-d046-47be-aa47-f04e421235de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:56.592519 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-596cc5fb-d046-47be-aa47-f04e421235de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:56.593283 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-596cc5fb-d046-47be-aa47-f04e421235de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:56.593698 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-596cc5fb-d046-47be-aa47-f04e421235de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:56.721337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-596cc5fb-d046-47be-aa47-f04e421235de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:56.728626 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-596cc5fb-d046-47be-aa47-f04e421235de tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.146891 Jul 19 09:31:56.729188 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 439/852] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:56 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:31:57.598573 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-44be7d6b-8407-46ad-8998-2781007e688f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:57.599134 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-44be7d6b-8407-46ad-8998-2781007e688f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:57.605554 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44be7d6b-8407-46ad-8998-2781007e688f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:57.606011 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44be7d6b-8407-46ad-8998-2781007e688f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:57.607200 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44be7d6b-8407-46ad-8998-2781007e688f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:57.607985 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-44be7d6b-8407-46ad-8998-2781007e688f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:57.745263 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c8146957-9da4-441f-9a84-3cc5304eb9e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:57.745864 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c8146957-9da4-441f-9a84-3cc5304eb9e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:57.751435 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-44be7d6b-8407-46ad-8998-2781007e688f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:57.751682 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c8146957-9da4-441f-9a84-3cc5304eb9e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:57.752137 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c8146957-9da4-441f-9a84-3cc5304eb9e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:57.752912 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c8146957-9da4-441f-9a84-3cc5304eb9e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:57.753348 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c8146957-9da4-441f-9a84-3cc5304eb9e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:57.759666 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-44be7d6b-8407-46ad-8998-2781007e688f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:57.761163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-44be7d6b-8407-46ad-8998-2781007e688f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:57.762293 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-44be7d6b-8407-46ad-8998-2781007e688f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.167518 Jul 19 09:31:57.762857 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 414/853] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:57 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:57.887897 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c8146957-9da4-441f-9a84-3cc5304eb9e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:57.895533 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c8146957-9da4-441f-9a84-3cc5304eb9e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.154336 Jul 19 09:31:57.896099 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 440/854] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:57 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:31:58.780722 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4b2039c9-18d1-4f3a-8449-8cedeb1bf838 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:58.781327 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4b2039c9-18d1-4f3a-8449-8cedeb1bf838 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:58.787166 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4b2039c9-18d1-4f3a-8449-8cedeb1bf838 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:58.787615 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4b2039c9-18d1-4f3a-8449-8cedeb1bf838 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:58.788380 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4b2039c9-18d1-4f3a-8449-8cedeb1bf838 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:58.788810 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4b2039c9-18d1-4f3a-8449-8cedeb1bf838 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:58.912844 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1dc0f224-57cc-44b5-87ea-5d11fd8217e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:58.913518 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1dc0f224-57cc-44b5-87ea-5d11fd8217e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:58.919287 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4b2039c9-18d1-4f3a-8449-8cedeb1bf838 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:58.919476 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1dc0f224-57cc-44b5-87ea-5d11fd8217e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:58.919962 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1dc0f224-57cc-44b5-87ea-5d11fd8217e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:58.920739 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1dc0f224-57cc-44b5-87ea-5d11fd8217e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:58.921179 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1dc0f224-57cc-44b5-87ea-5d11fd8217e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:58.927609 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4b2039c9-18d1-4f3a-8449-8cedeb1bf838 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:58.929111 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4b2039c9-18d1-4f3a-8449-8cedeb1bf838 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:58.930282 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4b2039c9-18d1-4f3a-8449-8cedeb1bf838 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153309 Jul 19 09:31:58.930841 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 415/855] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:58 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:31:59.051131 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1dc0f224-57cc-44b5-87ea-5d11fd8217e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:31:59.058886 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1dc0f224-57cc-44b5-87ea-5d11fd8217e6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.149726 Jul 19 09:31:59.059489 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 441/856] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:31:58 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:31:59.948940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c877a0b8-9bf9-461f-921f-d65c8a6955f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:31:59.949558 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c877a0b8-9bf9-461f-921f-d65c8a6955f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:31:59.955423 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c877a0b8-9bf9-461f-921f-d65c8a6955f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:59.955872 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c877a0b8-9bf9-461f-921f-d65c8a6955f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:31:59.956633 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c877a0b8-9bf9-461f-921f-d65c8a6955f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:31:59.957067 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c877a0b8-9bf9-461f-921f-d65c8a6955f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:00.075572 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a166dc0f-9735-4d46-a014-fde73d6d9db8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:00.076174 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a166dc0f-9735-4d46-a014-fde73d6d9db8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:00.081826 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a166dc0f-9735-4d46-a014-fde73d6d9db8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:00.082273 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a166dc0f-9735-4d46-a014-fde73d6d9db8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:00.083052 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a166dc0f-9735-4d46-a014-fde73d6d9db8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:00.083493 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a166dc0f-9735-4d46-a014-fde73d6d9db8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:00.091948 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c877a0b8-9bf9-461f-921f-d65c8a6955f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:00.100752 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c877a0b8-9bf9-461f-921f-d65c8a6955f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:00.102843 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c877a0b8-9bf9-461f-921f-d65c8a6955f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:00.104019 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c877a0b8-9bf9-461f-921f-d65c8a6955f8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.159352 Jul 19 09:32:00.104581 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 416/857] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:31:59 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:00.214374 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a166dc0f-9735-4d46-a014-fde73d6d9db8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:00.221617 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a166dc0f-9735-4d46-a014-fde73d6d9db8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.149709 Jul 19 09:32:00.222218 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 442/858] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:00 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:01.122439 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c3fc9c85-fbd3-4918-8484-2e975ec8d8a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:01.123125 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c3fc9c85-fbd3-4918-8484-2e975ec8d8a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:01.128880 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3fc9c85-fbd3-4918-8484-2e975ec8d8a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:01.129326 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3fc9c85-fbd3-4918-8484-2e975ec8d8a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:01.130093 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3fc9c85-fbd3-4918-8484-2e975ec8d8a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:01.130529 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3fc9c85-fbd3-4918-8484-2e975ec8d8a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:01.238039 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d93f10c1-0f4b-409e-a775-90dec532600d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:01.238649 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d93f10c1-0f4b-409e-a775-90dec532600d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:01.244377 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d93f10c1-0f4b-409e-a775-90dec532600d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:01.244830 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d93f10c1-0f4b-409e-a775-90dec532600d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:01.245602 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d93f10c1-0f4b-409e-a775-90dec532600d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:01.246037 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d93f10c1-0f4b-409e-a775-90dec532600d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:01.261130 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c3fc9c85-fbd3-4918-8484-2e975ec8d8a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:01.269620 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c3fc9c85-fbd3-4918-8484-2e975ec8d8a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:01.271253 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c3fc9c85-fbd3-4918-8484-2e975ec8d8a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:01.272398 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c3fc9c85-fbd3-4918-8484-2e975ec8d8a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153801 Jul 19 09:32:01.272957 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 417/859] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:01 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:01.378508 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d93f10c1-0f4b-409e-a775-90dec532600d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:01.386341 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d93f10c1-0f4b-409e-a775-90dec532600d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.151902 Jul 19 09:32:01.386906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 443/860] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:01 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:02.291808 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f3b11a8e-d0be-419e-b3c6-aa26f9048230 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:02.292408 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f3b11a8e-d0be-419e-b3c6-aa26f9048230 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:02.298207 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f3b11a8e-d0be-419e-b3c6-aa26f9048230 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:02.298651 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f3b11a8e-d0be-419e-b3c6-aa26f9048230 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:02.299427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f3b11a8e-d0be-419e-b3c6-aa26f9048230 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:02.299861 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f3b11a8e-d0be-419e-b3c6-aa26f9048230 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:02.403380 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-67d43ca8-63e0-4b7a-9b48-67b219a027c2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:02.404086 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-67d43ca8-63e0-4b7a-9b48-67b219a027c2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:02.410743 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67d43ca8-63e0-4b7a-9b48-67b219a027c2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:02.411302 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67d43ca8-63e0-4b7a-9b48-67b219a027c2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:02.412207 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67d43ca8-63e0-4b7a-9b48-67b219a027c2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:02.412718 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67d43ca8-63e0-4b7a-9b48-67b219a027c2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:02.432193 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f3b11a8e-d0be-419e-b3c6-aa26f9048230 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:02.440261 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f3b11a8e-d0be-419e-b3c6-aa26f9048230 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:02.441747 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f3b11a8e-d0be-419e-b3c6-aa26f9048230 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:02.442904 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f3b11a8e-d0be-419e-b3c6-aa26f9048230 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.155629 Jul 19 09:32:02.443488 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 418/861] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:02 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:02.542657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-67d43ca8-63e0-4b7a-9b48-67b219a027c2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:02.549916 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-67d43ca8-63e0-4b7a-9b48-67b219a027c2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.150204 Jul 19 09:32:02.550477 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 444/862] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:02 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:03.462014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-77171cc0-208a-4a9e-90d0-1bc37b004a3d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:03.462551 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-77171cc0-208a-4a9e-90d0-1bc37b004a3d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:03.468940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-77171cc0-208a-4a9e-90d0-1bc37b004a3d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:03.469390 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-77171cc0-208a-4a9e-90d0-1bc37b004a3d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:03.470167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-77171cc0-208a-4a9e-90d0-1bc37b004a3d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:03.470630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-77171cc0-208a-4a9e-90d0-1bc37b004a3d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:03.566657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7738881e-a720-4993-9d10-c53898edc80b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:03.567278 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7738881e-a720-4993-9d10-c53898edc80b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:03.573705 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7738881e-a720-4993-9d10-c53898edc80b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:03.574232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7738881e-a720-4993-9d10-c53898edc80b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:03.575210 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7738881e-a720-4993-9d10-c53898edc80b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:03.575719 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7738881e-a720-4993-9d10-c53898edc80b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:03.606119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-77171cc0-208a-4a9e-90d0-1bc37b004a3d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:03.614542 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-77171cc0-208a-4a9e-90d0-1bc37b004a3d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:03.616058 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-77171cc0-208a-4a9e-90d0-1bc37b004a3d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:03.617693 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-77171cc0-208a-4a9e-90d0-1bc37b004a3d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.159622 Jul 19 09:32:03.618248 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 419/863] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:03 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:03.711302 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7738881e-a720-4993-9d10-c53898edc80b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:03.718558 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7738881e-a720-4993-9d10-c53898edc80b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.155505 Jul 19 09:32:03.719082 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 445/864] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:03 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:04.636062 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-93f008a8-e144-4a29-934e-0367e15dc192 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:04.636673 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-93f008a8-e144-4a29-934e-0367e15dc192 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:04.642864 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93f008a8-e144-4a29-934e-0367e15dc192 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:04.643344 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93f008a8-e144-4a29-934e-0367e15dc192 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:04.644113 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93f008a8-e144-4a29-934e-0367e15dc192 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:04.644549 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93f008a8-e144-4a29-934e-0367e15dc192 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:04.735262 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-eb398cfb-ce1a-4c3f-93fa-97dbd24b3842 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:04.736245 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-eb398cfb-ce1a-4c3f-93fa-97dbd24b3842 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:04.741740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eb398cfb-ce1a-4c3f-93fa-97dbd24b3842 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:04.742186 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eb398cfb-ce1a-4c3f-93fa-97dbd24b3842 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:04.742943 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eb398cfb-ce1a-4c3f-93fa-97dbd24b3842 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:04.743396 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eb398cfb-ce1a-4c3f-93fa-97dbd24b3842 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:04.777058 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-93f008a8-e144-4a29-934e-0367e15dc192 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:04.785191 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-93f008a8-e144-4a29-934e-0367e15dc192 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:04.786677 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-93f008a8-e144-4a29-934e-0367e15dc192 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:04.787826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-93f008a8-e144-4a29-934e-0367e15dc192 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.155496 Jul 19 09:32:04.788391 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 420/865] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:04 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:04.875215 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-eb398cfb-ce1a-4c3f-93fa-97dbd24b3842 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:04.882322 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-eb398cfb-ce1a-4c3f-93fa-97dbd24b3842 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.150733 Jul 19 09:32:04.883447 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 446/866] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:04 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:05.805981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-99fea2ca-7300-4af9-9e01-e7f8a7c8cdd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:05.806577 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-99fea2ca-7300-4af9-9e01-e7f8a7c8cdd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:05.812648 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-99fea2ca-7300-4af9-9e01-e7f8a7c8cdd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:05.813092 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-99fea2ca-7300-4af9-9e01-e7f8a7c8cdd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:05.813844 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-99fea2ca-7300-4af9-9e01-e7f8a7c8cdd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:05.814273 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-99fea2ca-7300-4af9-9e01-e7f8a7c8cdd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:05.899350 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f5caf4a3-5d18-4dad-943c-ab442f4f6a03 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:05.899956 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f5caf4a3-5d18-4dad-943c-ab442f4f6a03 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:05.905577 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5caf4a3-5d18-4dad-943c-ab442f4f6a03 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:05.906048 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5caf4a3-5d18-4dad-943c-ab442f4f6a03 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:05.906802 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5caf4a3-5d18-4dad-943c-ab442f4f6a03 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:05.907255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5caf4a3-5d18-4dad-943c-ab442f4f6a03 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:05.948670 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-99fea2ca-7300-4af9-9e01-e7f8a7c8cdd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:05.956785 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-99fea2ca-7300-4af9-9e01-e7f8a7c8cdd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:05.958282 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-99fea2ca-7300-4af9-9e01-e7f8a7c8cdd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:05.959444 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-99fea2ca-7300-4af9-9e01-e7f8a7c8cdd5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.157155 Jul 19 09:32:05.960198 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 421/867] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:05 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:06.040904 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f5caf4a3-5d18-4dad-943c-ab442f4f6a03 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:06.048486 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f5caf4a3-5d18-4dad-943c-ab442f4f6a03 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152727 Jul 19 09:32:06.049063 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 447/868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:05 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:06.978214 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1749c161-54a6-4b41-8460-2666f50c280c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:06.978831 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1749c161-54a6-4b41-8460-2666f50c280c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:06.984541 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1749c161-54a6-4b41-8460-2666f50c280c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:06.984991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1749c161-54a6-4b41-8460-2666f50c280c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:06.985756 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1749c161-54a6-4b41-8460-2666f50c280c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:06.986190 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1749c161-54a6-4b41-8460-2666f50c280c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:07.064736 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-98e6ea1f-2ba7-486f-836c-7f1347f64eec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:07.065435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-98e6ea1f-2ba7-486f-836c-7f1347f64eec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:07.072084 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-98e6ea1f-2ba7-486f-836c-7f1347f64eec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:07.072567 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-98e6ea1f-2ba7-486f-836c-7f1347f64eec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:07.073371 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-98e6ea1f-2ba7-486f-836c-7f1347f64eec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:07.073808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-98e6ea1f-2ba7-486f-836c-7f1347f64eec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:07.225402 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-98e6ea1f-2ba7-486f-836c-7f1347f64eec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:07.233627 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-98e6ea1f-2ba7-486f-836c-7f1347f64eec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.172463 Jul 19 09:32:07.234126 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 448/869] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:07 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:07.332092 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1749c161-54a6-4b41-8460-2666f50c280c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:07.340668 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1749c161-54a6-4b41-8460-2666f50c280c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:07.342160 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1749c161-54a6-4b41-8460-2666f50c280c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:07.343315 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1749c161-54a6-4b41-8460-2666f50c280c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.369516 Jul 19 09:32:07.343862 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 422/870] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:06 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:08.250542 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a28d3628-2fc6-4331-af14-b7d0fe97a24c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:08.251170 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a28d3628-2fc6-4331-af14-b7d0fe97a24c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:08.257054 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a28d3628-2fc6-4331-af14-b7d0fe97a24c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:08.257500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a28d3628-2fc6-4331-af14-b7d0fe97a24c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:08.258261 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a28d3628-2fc6-4331-af14-b7d0fe97a24c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:08.258721 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a28d3628-2fc6-4331-af14-b7d0fe97a24c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:08.361862 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6ce37f8d-3467-4236-aef2-fd793744a147 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:08.362533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6ce37f8d-3467-4236-aef2-fd793744a147 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:08.368980 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ce37f8d-3467-4236-aef2-fd793744a147 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:08.369432 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ce37f8d-3467-4236-aef2-fd793744a147 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:08.370196 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ce37f8d-3467-4236-aef2-fd793744a147 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:08.370626 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ce37f8d-3467-4236-aef2-fd793744a147 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:08.396891 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a28d3628-2fc6-4331-af14-b7d0fe97a24c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:08.407487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a28d3628-2fc6-4331-af14-b7d0fe97a24c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.160251 Jul 19 09:32:08.408462 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 449/871] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:08 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:08.501009 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6ce37f8d-3467-4236-aef2-fd793744a147 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:08.509198 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6ce37f8d-3467-4236-aef2-fd793744a147 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:08.510708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6ce37f8d-3467-4236-aef2-fd793744a147 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:08.511878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6ce37f8d-3467-4236-aef2-fd793744a147 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153729 Jul 19 09:32:08.512435 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 423/872] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:08 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:09.425960 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b49a2772-f9db-42f2-9169-76cc713f5d57 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:09.426583 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b49a2772-f9db-42f2-9169-76cc713f5d57 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:09.433232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b49a2772-f9db-42f2-9169-76cc713f5d57 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:09.433700 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b49a2772-f9db-42f2-9169-76cc713f5d57 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:09.434455 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b49a2772-f9db-42f2-9169-76cc713f5d57 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:09.434881 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b49a2772-f9db-42f2-9169-76cc713f5d57 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:09.529743 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ca28ffa8-7852-420e-8535-a65f17406352 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:09.530385 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ca28ffa8-7852-420e-8535-a65f17406352 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:09.536264 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca28ffa8-7852-420e-8535-a65f17406352 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:09.536716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca28ffa8-7852-420e-8535-a65f17406352 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:09.537488 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca28ffa8-7852-420e-8535-a65f17406352 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:09.537924 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca28ffa8-7852-420e-8535-a65f17406352 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:09.571668 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b49a2772-f9db-42f2-9169-76cc713f5d57 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:09.578996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b49a2772-f9db-42f2-9169-76cc713f5d57 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.157140 Jul 19 09:32:09.579644 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 450/873] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:09 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:09.670829 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ca28ffa8-7852-420e-8535-a65f17406352 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:09.679081 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ca28ffa8-7852-420e-8535-a65f17406352 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:09.681133 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ca28ffa8-7852-420e-8535-a65f17406352 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:09.682266 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ca28ffa8-7852-420e-8535-a65f17406352 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156303 Jul 19 09:32:09.682827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 424/874] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:09 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:10.595954 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-77eb2f76-5092-4568-9751-d5c167de1fa9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:10.596558 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-77eb2f76-5092-4568-9751-d5c167de1fa9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:10.602890 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-77eb2f76-5092-4568-9751-d5c167de1fa9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:10.603365 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-77eb2f76-5092-4568-9751-d5c167de1fa9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:10.604113 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-77eb2f76-5092-4568-9751-d5c167de1fa9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:10.604537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-77eb2f76-5092-4568-9751-d5c167de1fa9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:10.699308 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fa499bd1-5bdb-4799-a6c5-abef9233ae01 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:10.699915 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fa499bd1-5bdb-4799-a6c5-abef9233ae01 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:10.705855 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa499bd1-5bdb-4799-a6c5-abef9233ae01 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:10.706301 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa499bd1-5bdb-4799-a6c5-abef9233ae01 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:10.707110 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa499bd1-5bdb-4799-a6c5-abef9233ae01 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:10.707543 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa499bd1-5bdb-4799-a6c5-abef9233ae01 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:10.734946 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-77eb2f76-5092-4568-9751-d5c167de1fa9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:10.743809 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-77eb2f76-5092-4568-9751-d5c167de1fa9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.151529 Jul 19 09:32:10.744379 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 451/875] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:10 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:10.838527 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fa499bd1-5bdb-4799-a6c5-abef9233ae01 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:10.846947 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fa499bd1-5bdb-4799-a6c5-abef9233ae01 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:10.848487 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fa499bd1-5bdb-4799-a6c5-abef9233ae01 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:10.849643 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fa499bd1-5bdb-4799-a6c5-abef9233ae01 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154112 Jul 19 09:32:10.850222 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 425/876] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:10 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:11.760532 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e0bf32c9-b6e6-4785-9818-27aab47af8c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:11.761140 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e0bf32c9-b6e6-4785-9818-27aab47af8c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:11.766891 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e0bf32c9-b6e6-4785-9818-27aab47af8c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:11.767366 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e0bf32c9-b6e6-4785-9818-27aab47af8c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:11.768121 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e0bf32c9-b6e6-4785-9818-27aab47af8c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:11.768555 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e0bf32c9-b6e6-4785-9818-27aab47af8c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:11.868713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cd52fe1a-8dd1-4750-b4c5-f0c1aa000c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:11.869406 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cd52fe1a-8dd1-4750-b4c5-f0c1aa000c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:11.875741 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cd52fe1a-8dd1-4750-b4c5-f0c1aa000c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:11.876185 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cd52fe1a-8dd1-4750-b4c5-f0c1aa000c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:11.876942 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cd52fe1a-8dd1-4750-b4c5-f0c1aa000c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:11.877407 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cd52fe1a-8dd1-4750-b4c5-f0c1aa000c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:11.905505 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e0bf32c9-b6e6-4785-9818-27aab47af8c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:11.913245 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e0bf32c9-b6e6-4785-9818-27aab47af8c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.156310 Jul 19 09:32:11.913881 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 452/877] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:11 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:12.013330 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cd52fe1a-8dd1-4750-b4c5-f0c1aa000c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:12.021462 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cd52fe1a-8dd1-4750-b4c5-f0c1aa000c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:12.022963 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cd52fe1a-8dd1-4750-b4c5-f0c1aa000c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:12.024678 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cd52fe1a-8dd1-4750-b4c5-f0c1aa000c60 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.159917 Jul 19 09:32:12.025242 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 426/878] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:11 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:13.025997 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e3785baa-b4c1-4f92-bbb5-652e2c571a48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:13.026608 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e3785baa-b4c1-4f92-bbb5-652e2c571a48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:13.032422 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e3785baa-b4c1-4f92-bbb5-652e2c571a48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:13.032873 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e3785baa-b4c1-4f92-bbb5-652e2c571a48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:13.033633 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e3785baa-b4c1-4f92-bbb5-652e2c571a48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:13.034065 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e3785baa-b4c1-4f92-bbb5-652e2c571a48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:13.043391 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c0fd708e-1ea3-4f26-b3a1-87efac643858 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:13.043997 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c0fd708e-1ea3-4f26-b3a1-87efac643858 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:13.049631 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c0fd708e-1ea3-4f26-b3a1-87efac643858 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:13.050072 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c0fd708e-1ea3-4f26-b3a1-87efac643858 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:13.050830 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c0fd708e-1ea3-4f26-b3a1-87efac643858 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:13.051299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c0fd708e-1ea3-4f26-b3a1-87efac643858 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:13.174381 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e3785baa-b4c1-4f92-bbb5-652e2c571a48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:13.182753 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e3785baa-b4c1-4f92-bbb5-652e2c571a48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.256650 Jul 19 09:32:13.192977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 453/879] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:12 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:13.193112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c0fd708e-1ea3-4f26-b3a1-87efac643858 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:13.194958 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c0fd708e-1ea3-4f26-b3a1-87efac643858 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:13.196479 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c0fd708e-1ea3-4f26-b3a1-87efac643858 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:13.197605 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c0fd708e-1ea3-4f26-b3a1-87efac643858 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.158706 Jul 19 09:32:13.198161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 427/880] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:13 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:14.184264 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:32:14.184820 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:32:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:32:14.199706 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-88c311c1-80a1-4f96-a92c-4d2243b2036d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:14.200321 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-88c311c1-80a1-4f96-a92c-4d2243b2036d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:14.206470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88c311c1-80a1-4f96-a92c-4d2243b2036d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:14.206921 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88c311c1-80a1-4f96-a92c-4d2243b2036d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:14.207715 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88c311c1-80a1-4f96-a92c-4d2243b2036d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:14.208150 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88c311c1-80a1-4f96-a92c-4d2243b2036d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:14.215817 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-46d3728d-58f4-48a4-be17-578d953df6d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:14.216453 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-46d3728d-58f4-48a4-be17-578d953df6d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:14.222332 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-46d3728d-58f4-48a4-be17-578d953df6d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:14.222780 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-46d3728d-58f4-48a4-be17-578d953df6d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:14.223570 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-46d3728d-58f4-48a4-be17-578d953df6d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:14.224001 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-46d3728d-58f4-48a4-be17-578d953df6d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:14.339381 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-88c311c1-80a1-4f96-a92c-4d2243b2036d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:14.346678 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-88c311c1-80a1-4f96-a92c-4d2243b2036d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.150665 Jul 19 09:32:14.347276 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 454/881] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:14 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:14.355883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-46d3728d-58f4-48a4-be17-578d953df6d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:14.363981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-46d3728d-58f4-48a4-be17-578d953df6d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:14.365472 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-46d3728d-58f4-48a4-be17-578d953df6d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:14.366661 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-46d3728d-58f4-48a4-be17-578d953df6d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154430 Jul 19 09:32:14.367748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 428/882] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:14 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:15.363265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d37b71cf-3604-4ba1-98fb-303c95682cda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:15.363865 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d37b71cf-3604-4ba1-98fb-303c95682cda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:15.369695 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d37b71cf-3604-4ba1-98fb-303c95682cda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:15.370147 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d37b71cf-3604-4ba1-98fb-303c95682cda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:15.370904 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d37b71cf-3604-4ba1-98fb-303c95682cda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:15.371359 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d37b71cf-3604-4ba1-98fb-303c95682cda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:15.384924 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-194d792e-e342-4bae-bc31-f90b2c114ad2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:15.385531 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-194d792e-e342-4bae-bc31-f90b2c114ad2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:15.391298 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-194d792e-e342-4bae-bc31-f90b2c114ad2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:15.391753 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-194d792e-e342-4bae-bc31-f90b2c114ad2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:15.392525 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-194d792e-e342-4bae-bc31-f90b2c114ad2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:15.392964 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-194d792e-e342-4bae-bc31-f90b2c114ad2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:15.506280 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d37b71cf-3604-4ba1-98fb-303c95682cda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:15.513712 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d37b71cf-3604-4ba1-98fb-303c95682cda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.154124 Jul 19 09:32:15.514287 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 455/883] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:15 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:15.529247 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-194d792e-e342-4bae-bc31-f90b2c114ad2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:15.537232 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-194d792e-e342-4bae-bc31-f90b2c114ad2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:15.539336 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-194d792e-e342-4bae-bc31-f90b2c114ad2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:15.540734 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-194d792e-e342-4bae-bc31-f90b2c114ad2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.159531 Jul 19 09:32:15.541277 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 429/884] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:15 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:16.531113 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-340dd88a-9854-4c85-ac61-9d84d04c86e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:16.531751 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-340dd88a-9854-4c85-ac61-9d84d04c86e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:16.537482 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-340dd88a-9854-4c85-ac61-9d84d04c86e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:16.537929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-340dd88a-9854-4c85-ac61-9d84d04c86e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:16.539217 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-340dd88a-9854-4c85-ac61-9d84d04c86e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:16.539905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-340dd88a-9854-4c85-ac61-9d84d04c86e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:16.559114 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c42a86c6-d0e8-48e2-a878-2bb90f78ba4b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:16.559720 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c42a86c6-d0e8-48e2-a878-2bb90f78ba4b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:16.565378 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c42a86c6-d0e8-48e2-a878-2bb90f78ba4b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:16.565828 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c42a86c6-d0e8-48e2-a878-2bb90f78ba4b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:16.566594 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c42a86c6-d0e8-48e2-a878-2bb90f78ba4b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:16.567028 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c42a86c6-d0e8-48e2-a878-2bb90f78ba4b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:16.671540 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-340dd88a-9854-4c85-ac61-9d84d04c86e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:16.678914 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-340dd88a-9854-4c85-ac61-9d84d04c86e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.151415 Jul 19 09:32:16.680046 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 456/885] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:16 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:16.699181 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c42a86c6-d0e8-48e2-a878-2bb90f78ba4b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:16.707284 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c42a86c6-d0e8-48e2-a878-2bb90f78ba4b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:16.708790 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c42a86c6-d0e8-48e2-a878-2bb90f78ba4b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:16.709921 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c42a86c6-d0e8-48e2-a878-2bb90f78ba4b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154413 Jul 19 09:32:16.710473 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 430/886] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:16 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:17.696651 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1c4d7786-0194-4efa-a5c4-e9ae77a3bccf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:17.697288 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1c4d7786-0194-4efa-a5c4-e9ae77a3bccf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:17.703088 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c4d7786-0194-4efa-a5c4-e9ae77a3bccf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:17.703537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c4d7786-0194-4efa-a5c4-e9ae77a3bccf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:17.704302 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c4d7786-0194-4efa-a5c4-e9ae77a3bccf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:17.704743 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c4d7786-0194-4efa-a5c4-e9ae77a3bccf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:17.727816 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ed1e91a1-a35d-4abf-9e61-9bd08cebe822 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:17.728420 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ed1e91a1-a35d-4abf-9e61-9bd08cebe822 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:17.734590 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ed1e91a1-a35d-4abf-9e61-9bd08cebe822 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:17.735061 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ed1e91a1-a35d-4abf-9e61-9bd08cebe822 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:17.735835 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ed1e91a1-a35d-4abf-9e61-9bd08cebe822 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:17.736269 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ed1e91a1-a35d-4abf-9e61-9bd08cebe822 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:17.835817 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1c4d7786-0194-4efa-a5c4-e9ae77a3bccf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:17.843621 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1c4d7786-0194-4efa-a5c4-e9ae77a3bccf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.151180 Jul 19 09:32:17.844550 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 457/887] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:17 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:17.877533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ed1e91a1-a35d-4abf-9e61-9bd08cebe822 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:17.885620 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ed1e91a1-a35d-4abf-9e61-9bd08cebe822 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:17.887153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ed1e91a1-a35d-4abf-9e61-9bd08cebe822 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:17.888301 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ed1e91a1-a35d-4abf-9e61-9bd08cebe822 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.164211 Jul 19 09:32:17.888838 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 431/888] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:17 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:18.860857 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-67c7d9d1-2866-4181-b423-e8cecd108cb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:18.861462 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-67c7d9d1-2866-4181-b423-e8cecd108cb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:18.867569 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67c7d9d1-2866-4181-b423-e8cecd108cb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:18.868019 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67c7d9d1-2866-4181-b423-e8cecd108cb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:18.868784 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67c7d9d1-2866-4181-b423-e8cecd108cb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:18.869219 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-67c7d9d1-2866-4181-b423-e8cecd108cb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:18.905524 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-629d4c70-814b-43c1-8c92-78385b85ec6e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:18.906159 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-629d4c70-814b-43c1-8c92-78385b85ec6e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:18.912125 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-629d4c70-814b-43c1-8c92-78385b85ec6e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:18.912598 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-629d4c70-814b-43c1-8c92-78385b85ec6e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:18.913394 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-629d4c70-814b-43c1-8c92-78385b85ec6e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:18.913830 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-629d4c70-814b-43c1-8c92-78385b85ec6e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:19.053762 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-629d4c70-814b-43c1-8c92-78385b85ec6e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:19.063162 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-629d4c70-814b-43c1-8c92-78385b85ec6e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:19.064694 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-629d4c70-814b-43c1-8c92-78385b85ec6e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:19.065850 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-629d4c70-814b-43c1-8c92-78385b85ec6e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.164137 Jul 19 09:32:19.066414 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 432/889] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:18 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:19.194398 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-67c7d9d1-2866-4181-b423-e8cecd108cb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:19.202518 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-67c7d9d1-2866-4181-b423-e8cecd108cb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.345279 Jul 19 09:32:19.203183 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 458/890] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:18 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:20.084706 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-14e99c81-2010-4e59-81e2-f62912f44cbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:20.085805 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-14e99c81-2010-4e59-81e2-f62912f44cbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:20.091550 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14e99c81-2010-4e59-81e2-f62912f44cbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:20.091991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14e99c81-2010-4e59-81e2-f62912f44cbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:20.092743 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14e99c81-2010-4e59-81e2-f62912f44cbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:20.093170 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14e99c81-2010-4e59-81e2-f62912f44cbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:20.219167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-40dfb8fc-5815-42ca-89bd-de21db472365 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:20.219771 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-40dfb8fc-5815-42ca-89bd-de21db472365 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:20.225531 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40dfb8fc-5815-42ca-89bd-de21db472365 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:20.225724 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-14e99c81-2010-4e59-81e2-f62912f44cbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:20.226067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40dfb8fc-5815-42ca-89bd-de21db472365 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:20.226815 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40dfb8fc-5815-42ca-89bd-de21db472365 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:20.227273 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40dfb8fc-5815-42ca-89bd-de21db472365 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:20.233854 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-14e99c81-2010-4e59-81e2-f62912f44cbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:20.235363 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-14e99c81-2010-4e59-81e2-f62912f44cbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:20.236497 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-14e99c81-2010-4e59-81e2-f62912f44cbb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.155549 Jul 19 09:32:20.237054 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 433/891] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:20 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:20.355763 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-40dfb8fc-5815-42ca-89bd-de21db472365 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:20.362867 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-40dfb8fc-5815-42ca-89bd-de21db472365 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.147506 Jul 19 09:32:20.363452 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 459/892] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:20 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:21.255787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9dbba6f2-1720-444c-9f03-aa5b0af71ce5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:21.256398 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9dbba6f2-1720-444c-9f03-aa5b0af71ce5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:21.262783 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9dbba6f2-1720-444c-9f03-aa5b0af71ce5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:21.263281 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9dbba6f2-1720-444c-9f03-aa5b0af71ce5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:21.264050 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9dbba6f2-1720-444c-9f03-aa5b0af71ce5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:21.264486 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9dbba6f2-1720-444c-9f03-aa5b0af71ce5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:21.380092 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6b6c3eaf-dea2-41ed-a7cb-a5ef5950dae0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:21.380707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6b6c3eaf-dea2-41ed-a7cb-a5ef5950dae0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:21.386999 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6b6c3eaf-dea2-41ed-a7cb-a5ef5950dae0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:21.387475 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6b6c3eaf-dea2-41ed-a7cb-a5ef5950dae0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:21.388242 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6b6c3eaf-dea2-41ed-a7cb-a5ef5950dae0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:21.388680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6b6c3eaf-dea2-41ed-a7cb-a5ef5950dae0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:21.399237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9dbba6f2-1720-444c-9f03-aa5b0af71ce5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:21.407647 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9dbba6f2-1720-444c-9f03-aa5b0af71ce5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:21.409214 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9dbba6f2-1720-444c-9f03-aa5b0af71ce5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:21.410346 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9dbba6f2-1720-444c-9f03-aa5b0af71ce5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.158303 Jul 19 09:32:21.410914 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 434/893] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:21 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:21.519625 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6b6c3eaf-dea2-41ed-a7cb-a5ef5950dae0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:21.526841 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6b6c3eaf-dea2-41ed-a7cb-a5ef5950dae0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.150433 Jul 19 09:32:21.527435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 460/894] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:21 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:22.427841 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6b595095-6b4a-40e4-ae8d-81f6fcc09e58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:22.428441 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6b595095-6b4a-40e4-ae8d-81f6fcc09e58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:22.434114 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b595095-6b4a-40e4-ae8d-81f6fcc09e58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:22.434553 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b595095-6b4a-40e4-ae8d-81f6fcc09e58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:22.435331 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b595095-6b4a-40e4-ae8d-81f6fcc09e58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:22.435776 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b595095-6b4a-40e4-ae8d-81f6fcc09e58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:22.543604 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8677a60e-a86a-4a34-8f25-aa3e2c845664 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:22.544324 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8677a60e-a86a-4a34-8f25-aa3e2c845664 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:22.550255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8677a60e-a86a-4a34-8f25-aa3e2c845664 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:22.550707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8677a60e-a86a-4a34-8f25-aa3e2c845664 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:22.551502 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8677a60e-a86a-4a34-8f25-aa3e2c845664 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:22.551937 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8677a60e-a86a-4a34-8f25-aa3e2c845664 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:22.568706 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6b595095-6b4a-40e4-ae8d-81f6fcc09e58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:22.577283 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6b595095-6b4a-40e4-ae8d-81f6fcc09e58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:22.578787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6b595095-6b4a-40e4-ae8d-81f6fcc09e58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:22.579950 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6b595095-6b4a-40e4-ae8d-81f6fcc09e58 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.155782 Jul 19 09:32:22.580510 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 435/895] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:22 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:22.680244 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8677a60e-a86a-4a34-8f25-aa3e2c845664 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:22.687362 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8677a60e-a86a-4a34-8f25-aa3e2c845664 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.147570 Jul 19 09:32:22.687921 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 461/896] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:22 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:23.598784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0647ac64-fc56-4e05-a9d1-2c97a8f1101a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:23.599344 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0647ac64-fc56-4e05-a9d1-2c97a8f1101a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:23.605715 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0647ac64-fc56-4e05-a9d1-2c97a8f1101a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:23.606161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0647ac64-fc56-4e05-a9d1-2c97a8f1101a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:23.606917 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0647ac64-fc56-4e05-a9d1-2c97a8f1101a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:23.607453 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0647ac64-fc56-4e05-a9d1-2c97a8f1101a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:23.704691 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c9e849cf-44bf-4e77-b321-97d96965f7e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:23.705299 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c9e849cf-44bf-4e77-b321-97d96965f7e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:23.711890 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c9e849cf-44bf-4e77-b321-97d96965f7e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:23.712343 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c9e849cf-44bf-4e77-b321-97d96965f7e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:23.713110 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c9e849cf-44bf-4e77-b321-97d96965f7e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:23.713547 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c9e849cf-44bf-4e77-b321-97d96965f7e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:23.742825 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0647ac64-fc56-4e05-a9d1-2c97a8f1101a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:23.751265 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0647ac64-fc56-4e05-a9d1-2c97a8f1101a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:23.752794 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0647ac64-fc56-4e05-a9d1-2c97a8f1101a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:23.753930 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0647ac64-fc56-4e05-a9d1-2c97a8f1101a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.159010 Jul 19 09:32:23.754582 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 436/897] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:23 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:23.842081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c9e849cf-44bf-4e77-b321-97d96965f7e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:23.849368 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c9e849cf-44bf-4e77-b321-97d96965f7e1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.148437 Jul 19 09:32:23.849867 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 462/898] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:23 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:24.772360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fd413bec-c6b7-4cdb-87d2-5d988aa6189d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:24.773100 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fd413bec-c6b7-4cdb-87d2-5d988aa6189d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:24.778999 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fd413bec-c6b7-4cdb-87d2-5d988aa6189d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:24.779469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fd413bec-c6b7-4cdb-87d2-5d988aa6189d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:24.780235 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fd413bec-c6b7-4cdb-87d2-5d988aa6189d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:24.780662 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fd413bec-c6b7-4cdb-87d2-5d988aa6189d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:24.867168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c2050cad-e8fd-45bb-b3a5-917e3722fcbd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:24.867794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c2050cad-e8fd-45bb-b3a5-917e3722fcbd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:24.873465 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c2050cad-e8fd-45bb-b3a5-917e3722fcbd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:24.873914 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c2050cad-e8fd-45bb-b3a5-917e3722fcbd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:24.874677 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c2050cad-e8fd-45bb-b3a5-917e3722fcbd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:24.875134 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c2050cad-e8fd-45bb-b3a5-917e3722fcbd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:24.910760 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fd413bec-c6b7-4cdb-87d2-5d988aa6189d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:24.919912 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fd413bec-c6b7-4cdb-87d2-5d988aa6189d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:24.921409 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fd413bec-c6b7-4cdb-87d2-5d988aa6189d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:24.922553 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fd413bec-c6b7-4cdb-87d2-5d988aa6189d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154244 Jul 19 09:32:24.923127 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 437/899] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:24 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:25.008036 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c2050cad-e8fd-45bb-b3a5-917e3722fcbd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:25.015340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c2050cad-e8fd-45bb-b3a5-917e3722fcbd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.152508 Jul 19 09:32:25.015907 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 463/900] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:24 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:25.940888 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4c8dd7e0-a777-470e-962f-ebde6bbf2b03 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:25.941491 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4c8dd7e0-a777-470e-962f-ebde6bbf2b03 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:25.948149 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4c8dd7e0-a777-470e-962f-ebde6bbf2b03 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:25.948595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4c8dd7e0-a777-470e-962f-ebde6bbf2b03 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:25.949354 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4c8dd7e0-a777-470e-962f-ebde6bbf2b03 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:25.949787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4c8dd7e0-a777-470e-962f-ebde6bbf2b03 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:26.032141 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c5057882-b3f0-4ece-858a-a557616fef65 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:26.032857 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c5057882-b3f0-4ece-858a-a557616fef65 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:26.039442 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c5057882-b3f0-4ece-858a-a557616fef65 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:26.040153 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c5057882-b3f0-4ece-858a-a557616fef65 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:26.041005 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c5057882-b3f0-4ece-858a-a557616fef65 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:26.041353 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c5057882-b3f0-4ece-858a-a557616fef65 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:26.080801 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4c8dd7e0-a777-470e-962f-ebde6bbf2b03 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:26.089510 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4c8dd7e0-a777-470e-962f-ebde6bbf2b03 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:26.091009 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4c8dd7e0-a777-470e-962f-ebde6bbf2b03 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:26.092179 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4c8dd7e0-a777-470e-962f-ebde6bbf2b03 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154990 Jul 19 09:32:26.092734 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 438/901] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:25 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:26.172834 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c5057882-b3f0-4ece-858a-a557616fef65 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:26.180168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c5057882-b3f0-4ece-858a-a557616fef65 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.151684 Jul 19 09:32:26.180718 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 464/902] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:26 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:27.110474 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-13707a82-32fe-4d50-9d73-d8089abba55e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:27.111105 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-13707a82-32fe-4d50-9d73-d8089abba55e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:27.117581 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13707a82-32fe-4d50-9d73-d8089abba55e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:27.118029 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13707a82-32fe-4d50-9d73-d8089abba55e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:27.118826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13707a82-32fe-4d50-9d73-d8089abba55e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:27.119296 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13707a82-32fe-4d50-9d73-d8089abba55e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:27.196725 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3adc24d8-ea31-4feb-abf4-f65945916c13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:27.197321 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3adc24d8-ea31-4feb-abf4-f65945916c13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:27.203085 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3adc24d8-ea31-4feb-abf4-f65945916c13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:27.203576 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3adc24d8-ea31-4feb-abf4-f65945916c13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:27.204355 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3adc24d8-ea31-4feb-abf4-f65945916c13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:27.204836 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3adc24d8-ea31-4feb-abf4-f65945916c13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:27.255479 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-13707a82-32fe-4d50-9d73-d8089abba55e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:27.263962 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-13707a82-32fe-4d50-9d73-d8089abba55e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:27.265405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-13707a82-32fe-4d50-9d73-d8089abba55e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:27.266550 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-13707a82-32fe-4d50-9d73-d8089abba55e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.159850 Jul 19 09:32:27.267119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 439/903] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:27 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:27.341253 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3adc24d8-ea31-4feb-abf4-f65945916c13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:27.348517 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3adc24d8-ea31-4feb-abf4-f65945916c13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.155416 Jul 19 09:32:27.349079 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 465/904] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:27 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:28.284973 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-85a5f182-2197-4a9f-add8-af59128ba17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:28.285608 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-85a5f182-2197-4a9f-add8-af59128ba17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:28.292282 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-85a5f182-2197-4a9f-add8-af59128ba17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:28.292728 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-85a5f182-2197-4a9f-add8-af59128ba17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:28.293488 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-85a5f182-2197-4a9f-add8-af59128ba17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:28.293923 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-85a5f182-2197-4a9f-add8-af59128ba17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:28.365983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-575a237a-79a0-4ea9-89dd-2a644a4b4684 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:28.366527 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-575a237a-79a0-4ea9-89dd-2a644a4b4684 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:28.372299 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-575a237a-79a0-4ea9-89dd-2a644a4b4684 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:28.372757 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-575a237a-79a0-4ea9-89dd-2a644a4b4684 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:28.373535 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-575a237a-79a0-4ea9-89dd-2a644a4b4684 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:28.373979 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-575a237a-79a0-4ea9-89dd-2a644a4b4684 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:28.425046 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-85a5f182-2197-4a9f-add8-af59128ba17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:28.433361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-85a5f182-2197-4a9f-add8-af59128ba17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:28.434883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-85a5f182-2197-4a9f-add8-af59128ba17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:28.436755 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-85a5f182-2197-4a9f-add8-af59128ba17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.155342 Jul 19 09:32:28.437333 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 440/905] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:28 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:28.505277 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-575a237a-79a0-4ea9-89dd-2a644a4b4684 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:28.512500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-575a237a-79a0-4ea9-89dd-2a644a4b4684 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.150439 Jul 19 09:32:28.513063 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 466/906] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:28 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:29.455259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-eab91f63-22fb-43a8-835f-296e6738f4a9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:29.455772 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-eab91f63-22fb-43a8-835f-296e6738f4a9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:29.462138 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eab91f63-22fb-43a8-835f-296e6738f4a9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:29.462585 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eab91f63-22fb-43a8-835f-296e6738f4a9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:29.463382 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eab91f63-22fb-43a8-835f-296e6738f4a9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:29.463825 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eab91f63-22fb-43a8-835f-296e6738f4a9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:29.528906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f408f7fa-9499-42fc-b37f-2d7743b51bee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:29.529521 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f408f7fa-9499-42fc-b37f-2d7743b51bee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:29.535318 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f408f7fa-9499-42fc-b37f-2d7743b51bee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:29.535774 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f408f7fa-9499-42fc-b37f-2d7743b51bee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:29.536540 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f408f7fa-9499-42fc-b37f-2d7743b51bee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:29.536975 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f408f7fa-9499-42fc-b37f-2d7743b51bee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:29.598934 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-eab91f63-22fb-43a8-835f-296e6738f4a9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:29.607059 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-eab91f63-22fb-43a8-835f-296e6738f4a9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:29.608561 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-eab91f63-22fb-43a8-835f-296e6738f4a9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:29.609700 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-eab91f63-22fb-43a8-835f-296e6738f4a9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.158216 Jul 19 09:32:29.610260 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 441/907] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:29 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:29.668072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f408f7fa-9499-42fc-b37f-2d7743b51bee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:29.675304 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f408f7fa-9499-42fc-b37f-2d7743b51bee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.150044 Jul 19 09:32:29.675873 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 467/908] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:29 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:30.628269 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d5ee0422-d3c9-4bd8-8696-49577a4c9c31 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:30.628879 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d5ee0422-d3c9-4bd8-8696-49577a4c9c31 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:30.634781 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d5ee0422-d3c9-4bd8-8696-49577a4c9c31 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:30.635265 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d5ee0422-d3c9-4bd8-8696-49577a4c9c31 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:30.636028 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d5ee0422-d3c9-4bd8-8696-49577a4c9c31 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:30.636470 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d5ee0422-d3c9-4bd8-8696-49577a4c9c31 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:30.692440 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-77afb5ad-df6a-499f-8b5b-773af269d287 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:30.693148 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-77afb5ad-df6a-499f-8b5b-773af269d287 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:30.699406 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-77afb5ad-df6a-499f-8b5b-773af269d287 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:30.700162 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-77afb5ad-df6a-499f-8b5b-773af269d287 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:30.700994 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-77afb5ad-df6a-499f-8b5b-773af269d287 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:30.701432 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-77afb5ad-df6a-499f-8b5b-773af269d287 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:30.769867 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d5ee0422-d3c9-4bd8-8696-49577a4c9c31 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:30.777958 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d5ee0422-d3c9-4bd8-8696-49577a4c9c31 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:30.779465 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d5ee0422-d3c9-4bd8-8696-49577a4c9c31 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:30.780583 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d5ee0422-d3c9-4bd8-8696-49577a4c9c31 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156006 Jul 19 09:32:30.781133 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 442/909] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:30 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:30.834276 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-77afb5ad-df6a-499f-8b5b-773af269d287 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:30.841521 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-77afb5ad-df6a-499f-8b5b-773af269d287 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152753 Jul 19 09:32:30.842113 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 468/910] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:30 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:31.799123 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bd88fd51-a120-4343-a00a-b901566e56c1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:31.799631 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bd88fd51-a120-4343-a00a-b901566e56c1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:31.805915 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd88fd51-a120-4343-a00a-b901566e56c1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:31.806359 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd88fd51-a120-4343-a00a-b901566e56c1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:31.807330 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd88fd51-a120-4343-a00a-b901566e56c1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:31.807915 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd88fd51-a120-4343-a00a-b901566e56c1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:31.859470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b6bba4f0-d75d-4837-a7c3-66874ef7b1f2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:31.860070 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b6bba4f0-d75d-4837-a7c3-66874ef7b1f2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:31.866179 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6bba4f0-d75d-4837-a7c3-66874ef7b1f2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:31.866646 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6bba4f0-d75d-4837-a7c3-66874ef7b1f2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:31.867435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6bba4f0-d75d-4837-a7c3-66874ef7b1f2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:31.868232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6bba4f0-d75d-4837-a7c3-66874ef7b1f2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:31.941899 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bd88fd51-a120-4343-a00a-b901566e56c1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:31.950606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bd88fd51-a120-4343-a00a-b901566e56c1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:31.952116 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bd88fd51-a120-4343-a00a-b901566e56c1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:31.953247 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bd88fd51-a120-4343-a00a-b901566e56c1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.157872 Jul 19 09:32:31.953796 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 443/911] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:31 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:31.999963 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b6bba4f0-d75d-4837-a7c3-66874ef7b1f2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:32.007794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b6bba4f0-d75d-4837-a7c3-66874ef7b1f2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151995 Jul 19 09:32:32.008352 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 469/912] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:31 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:32.971189 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-832f43b9-6f8e-4a07-bd62-526ee7418bb2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:32.971805 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-832f43b9-6f8e-4a07-bd62-526ee7418bb2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:32.978152 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-832f43b9-6f8e-4a07-bd62-526ee7418bb2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:32.978606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-832f43b9-6f8e-4a07-bd62-526ee7418bb2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:32.979395 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-832f43b9-6f8e-4a07-bd62-526ee7418bb2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:32.979827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-832f43b9-6f8e-4a07-bd62-526ee7418bb2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:33.024760 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-969ae3f0-a121-49f4-9d7d-702a8520d608 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:33.025364 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-969ae3f0-a121-49f4-9d7d-702a8520d608 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:33.031056 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-969ae3f0-a121-49f4-9d7d-702a8520d608 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:33.031512 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-969ae3f0-a121-49f4-9d7d-702a8520d608 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:33.032275 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-969ae3f0-a121-49f4-9d7d-702a8520d608 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:33.032710 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-969ae3f0-a121-49f4-9d7d-702a8520d608 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:33.119097 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-832f43b9-6f8e-4a07-bd62-526ee7418bb2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:33.127483 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-832f43b9-6f8e-4a07-bd62-526ee7418bb2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:33.129639 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-832f43b9-6f8e-4a07-bd62-526ee7418bb2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:33.130763 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-832f43b9-6f8e-4a07-bd62-526ee7418bb2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.163330 Jul 19 09:32:33.131363 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 444/913] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:32 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:33.167620 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-969ae3f0-a121-49f4-9d7d-702a8520d608 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:33.174845 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-969ae3f0-a121-49f4-9d7d-702a8520d608 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.153736 Jul 19 09:32:33.175448 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 470/914] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:33 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:34.149188 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-373c87c7-b896-420f-adcb-b717ffb91867 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:34.149881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-373c87c7-b896-420f-adcb-b717ffb91867 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:34.155636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-373c87c7-b896-420f-adcb-b717ffb91867 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:34.156182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-373c87c7-b896-420f-adcb-b717ffb91867 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:34.157022 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-373c87c7-b896-420f-adcb-b717ffb91867 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:34.157526 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-373c87c7-b896-420f-adcb-b717ffb91867 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:34.192061 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6e3de30e-fd10-403d-be3e-c90d594cec89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:34.192670 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6e3de30e-fd10-403d-be3e-c90d594cec89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:34.198285 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6e3de30e-fd10-403d-be3e-c90d594cec89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:34.198732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6e3de30e-fd10-403d-be3e-c90d594cec89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:34.199534 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6e3de30e-fd10-403d-be3e-c90d594cec89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:34.199965 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6e3de30e-fd10-403d-be3e-c90d594cec89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:34.331576 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6e3de30e-fd10-403d-be3e-c90d594cec89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:34.339388 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6e3de30e-fd10-403d-be3e-c90d594cec89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150805 Jul 19 09:32:34.348681 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 471/915] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:34 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:34.366822 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-373c87c7-b896-420f-adcb-b717ffb91867 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:34.375078 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-373c87c7-b896-420f-adcb-b717ffb91867 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:34.376584 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-373c87c7-b896-420f-adcb-b717ffb91867 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:34.377714 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-373c87c7-b896-420f-adcb-b717ffb91867 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.232805 Jul 19 09:32:34.378276 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 445/916] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:34 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:35.356637 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-09522c04-d8f7-4391-b716-59406c901c73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:35.357243 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-09522c04-d8f7-4391-b716-59406c901c73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:35.363223 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09522c04-d8f7-4391-b716-59406c901c73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:35.363681 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09522c04-d8f7-4391-b716-59406c901c73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:35.364452 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09522c04-d8f7-4391-b716-59406c901c73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:35.364890 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09522c04-d8f7-4391-b716-59406c901c73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:35.396083 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-446b642c-b778-4986-a3e8-ac391014bc5e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:35.396662 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-446b642c-b778-4986-a3e8-ac391014bc5e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:35.402984 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-446b642c-b778-4986-a3e8-ac391014bc5e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:35.403465 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-446b642c-b778-4986-a3e8-ac391014bc5e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:35.404225 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-446b642c-b778-4986-a3e8-ac391014bc5e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:35.404655 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-446b642c-b778-4986-a3e8-ac391014bc5e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:35.497324 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-09522c04-d8f7-4391-b716-59406c901c73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:35.504730 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-09522c04-d8f7-4391-b716-59406c901c73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151726 Jul 19 09:32:35.505511 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 472/917] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:35 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:35.542315 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-446b642c-b778-4986-a3e8-ac391014bc5e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:35.550373 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-446b642c-b778-4986-a3e8-ac391014bc5e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:35.551889 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-446b642c-b778-4986-a3e8-ac391014bc5e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:35.553006 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-446b642c-b778-4986-a3e8-ac391014bc5e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.160578 Jul 19 09:32:35.553599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 446/918] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:35 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:36.520506 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-231609a9-92df-42df-9842-e804a7629657 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:36.521121 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-231609a9-92df-42df-9842-e804a7629657 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:36.527395 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-231609a9-92df-42df-9842-e804a7629657 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:36.527851 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-231609a9-92df-42df-9842-e804a7629657 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:36.528608 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-231609a9-92df-42df-9842-e804a7629657 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:36.529044 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-231609a9-92df-42df-9842-e804a7629657 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:36.571127 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cfb0198b-ca2d-4b18-ae50-a08de39cfdfd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:36.571677 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cfb0198b-ca2d-4b18-ae50-a08de39cfdfd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:36.577432 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cfb0198b-ca2d-4b18-ae50-a08de39cfdfd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:36.577883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cfb0198b-ca2d-4b18-ae50-a08de39cfdfd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:36.578650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cfb0198b-ca2d-4b18-ae50-a08de39cfdfd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:36.579104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cfb0198b-ca2d-4b18-ae50-a08de39cfdfd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:36.664969 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-231609a9-92df-42df-9842-e804a7629657 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:36.672849 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-231609a9-92df-42df-9842-e804a7629657 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.155701 Jul 19 09:32:36.681975 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 473/919] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:36 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:36.717701 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cfb0198b-ca2d-4b18-ae50-a08de39cfdfd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:36.725914 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cfb0198b-ca2d-4b18-ae50-a08de39cfdfd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:36.727442 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cfb0198b-ca2d-4b18-ae50-a08de39cfdfd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:36.728568 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cfb0198b-ca2d-4b18-ae50-a08de39cfdfd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.161389 Jul 19 09:32:36.729118 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 447/920] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:36 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:37.688162 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-16566ac1-8848-476f-9ed5-f4a0e669842b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:37.688767 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-16566ac1-8848-476f-9ed5-f4a0e669842b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:37.694544 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16566ac1-8848-476f-9ed5-f4a0e669842b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:37.694992 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16566ac1-8848-476f-9ed5-f4a0e669842b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:37.695779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16566ac1-8848-476f-9ed5-f4a0e669842b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:37.696208 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16566ac1-8848-476f-9ed5-f4a0e669842b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:37.746827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4ed6a787-de49-4a38-881a-08a114fa718e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:37.749195 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4ed6a787-de49-4a38-881a-08a114fa718e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:37.755305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4ed6a787-de49-4a38-881a-08a114fa718e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:37.755807 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4ed6a787-de49-4a38-881a-08a114fa718e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:37.756585 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4ed6a787-de49-4a38-881a-08a114fa718e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:37.757018 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4ed6a787-de49-4a38-881a-08a114fa718e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:37.836373 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-16566ac1-8848-476f-9ed5-f4a0e669842b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:37.843783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-16566ac1-8848-476f-9ed5-f4a0e669842b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.159207 Jul 19 09:32:37.844551 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 474/921] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:37 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:37.906590 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4ed6a787-de49-4a38-881a-08a114fa718e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:37.915636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4ed6a787-de49-4a38-881a-08a114fa718e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:37.917146 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4ed6a787-de49-4a38-881a-08a114fa718e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:37.918282 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4ed6a787-de49-4a38-881a-08a114fa718e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.175115 Jul 19 09:32:37.918840 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 448/922] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:37 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:38.861337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7ce96f61-ea23-4a08-bc23-bdae81ed9c67 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:38.862028 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7ce96f61-ea23-4a08-bc23-bdae81ed9c67 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:38.868440 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7ce96f61-ea23-4a08-bc23-bdae81ed9c67 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:38.868891 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7ce96f61-ea23-4a08-bc23-bdae81ed9c67 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:38.869658 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7ce96f61-ea23-4a08-bc23-bdae81ed9c67 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:38.870093 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7ce96f61-ea23-4a08-bc23-bdae81ed9c67 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:38.936306 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2009e694-c5b7-41fd-a290-7da9e6c11978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:38.936918 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2009e694-c5b7-41fd-a290-7da9e6c11978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:38.942736 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2009e694-c5b7-41fd-a290-7da9e6c11978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:38.943228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2009e694-c5b7-41fd-a290-7da9e6c11978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:38.944023 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2009e694-c5b7-41fd-a290-7da9e6c11978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:38.944458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2009e694-c5b7-41fd-a290-7da9e6c11978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:39.006122 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7ce96f61-ea23-4a08-bc23-bdae81ed9c67 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:39.013349 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7ce96f61-ea23-4a08-bc23-bdae81ed9c67 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.155616 Jul 19 09:32:39.013915 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 475/923] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:38 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:39.075719 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2009e694-c5b7-41fd-a290-7da9e6c11978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:39.083918 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2009e694-c5b7-41fd-a290-7da9e6c11978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:39.085444 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2009e694-c5b7-41fd-a290-7da9e6c11978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:39.086610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2009e694-c5b7-41fd-a290-7da9e6c11978 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153988 Jul 19 09:32:39.087265 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 449/924] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:38 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:40.029277 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9a23c148-2eec-44fb-8dbd-bdf7716f75e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:40.029885 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9a23c148-2eec-44fb-8dbd-bdf7716f75e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:40.035702 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9a23c148-2eec-44fb-8dbd-bdf7716f75e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:40.036158 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9a23c148-2eec-44fb-8dbd-bdf7716f75e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:40.036925 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9a23c148-2eec-44fb-8dbd-bdf7716f75e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:40.037365 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9a23c148-2eec-44fb-8dbd-bdf7716f75e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:40.104687 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-17cb158b-ef99-4cdf-8f3f-e9daca8ef043 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:40.105206 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-17cb158b-ef99-4cdf-8f3f-e9daca8ef043 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:40.111342 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-17cb158b-ef99-4cdf-8f3f-e9daca8ef043 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:40.111342 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-17cb158b-ef99-4cdf-8f3f-e9daca8ef043 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:40.112125 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-17cb158b-ef99-4cdf-8f3f-e9daca8ef043 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:40.112560 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-17cb158b-ef99-4cdf-8f3f-e9daca8ef043 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:40.170007 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9a23c148-2eec-44fb-8dbd-bdf7716f75e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:40.177332 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9a23c148-2eec-44fb-8dbd-bdf7716f75e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151661 Jul 19 09:32:40.178422 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 476/925] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:40 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:40.247425 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-17cb158b-ef99-4cdf-8f3f-e9daca8ef043 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:40.255713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-17cb158b-ef99-4cdf-8f3f-e9daca8ef043 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:40.257900 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-17cb158b-ef99-4cdf-8f3f-e9daca8ef043 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:40.259050 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-17cb158b-ef99-4cdf-8f3f-e9daca8ef043 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.158218 Jul 19 09:32:40.259610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 450/926] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:40 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:41.194687 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-66769595-a81c-47d9-aa3f-b31e33dbc66c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:41.195342 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-66769595-a81c-47d9-aa3f-b31e33dbc66c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:41.201058 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-66769595-a81c-47d9-aa3f-b31e33dbc66c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:41.201501 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-66769595-a81c-47d9-aa3f-b31e33dbc66c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:41.202250 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-66769595-a81c-47d9-aa3f-b31e33dbc66c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:41.202676 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-66769595-a81c-47d9-aa3f-b31e33dbc66c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:41.277075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fe43903f-9e6c-4880-8402-38d3abcfcb79 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:41.277665 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fe43903f-9e6c-4880-8402-38d3abcfcb79 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:41.283304 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fe43903f-9e6c-4880-8402-38d3abcfcb79 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:41.283752 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fe43903f-9e6c-4880-8402-38d3abcfcb79 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:41.284544 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fe43903f-9e6c-4880-8402-38d3abcfcb79 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:41.284976 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fe43903f-9e6c-4880-8402-38d3abcfcb79 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:41.331971 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-66769595-a81c-47d9-aa3f-b31e33dbc66c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:41.339382 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-66769595-a81c-47d9-aa3f-b31e33dbc66c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148309 Jul 19 09:32:41.339958 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 477/927] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:41 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:41.427403 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fe43903f-9e6c-4880-8402-38d3abcfcb79 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:41.435588 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fe43903f-9e6c-4880-8402-38d3abcfcb79 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:41.437106 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fe43903f-9e6c-4880-8402-38d3abcfcb79 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:41.438225 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fe43903f-9e6c-4880-8402-38d3abcfcb79 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.164876 Jul 19 09:32:41.438777 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 451/928] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:41 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:42.356699 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3544aeee-fbb7-4a31-85cb-1f9de6baa054 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:42.357237 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3544aeee-fbb7-4a31-85cb-1f9de6baa054 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:42.362930 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3544aeee-fbb7-4a31-85cb-1f9de6baa054 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:42.363402 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3544aeee-fbb7-4a31-85cb-1f9de6baa054 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:42.364154 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3544aeee-fbb7-4a31-85cb-1f9de6baa054 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:42.364579 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3544aeee-fbb7-4a31-85cb-1f9de6baa054 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:42.456739 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-700b88c3-068a-485f-9d0c-cbcd2ed9e9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:42.457344 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-700b88c3-068a-485f-9d0c-cbcd2ed9e9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:42.463647 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-700b88c3-068a-485f-9d0c-cbcd2ed9e9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:42.464094 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-700b88c3-068a-485f-9d0c-cbcd2ed9e9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:42.464849 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-700b88c3-068a-485f-9d0c-cbcd2ed9e9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:42.465279 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-700b88c3-068a-485f-9d0c-cbcd2ed9e9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:42.496945 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3544aeee-fbb7-4a31-85cb-1f9de6baa054 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:42.504396 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3544aeee-fbb7-4a31-85cb-1f9de6baa054 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151354 Jul 19 09:32:42.504969 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 478/929] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:42 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:42.595234 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-700b88c3-068a-485f-9d0c-cbcd2ed9e9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:42.603973 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-700b88c3-068a-485f-9d0c-cbcd2ed9e9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:42.605473 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-700b88c3-068a-485f-9d0c-cbcd2ed9e9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:42.606600 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-700b88c3-068a-485f-9d0c-cbcd2ed9e9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153734 Jul 19 09:32:42.607241 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 452/930] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:42 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:43.521110 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-88a83b44-f3a6-44e6-acc5-c362ac697017 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:43.521720 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-88a83b44-f3a6-44e6-acc5-c362ac697017 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:43.527556 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88a83b44-f3a6-44e6-acc5-c362ac697017 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:43.528006 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88a83b44-f3a6-44e6-acc5-c362ac697017 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:43.528818 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88a83b44-f3a6-44e6-acc5-c362ac697017 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:43.529256 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88a83b44-f3a6-44e6-acc5-c362ac697017 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:43.624618 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-36451a9f-395e-4410-aac9-85d3ea1b995a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:43.625225 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-36451a9f-395e-4410-aac9-85d3ea1b995a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:43.631061 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-36451a9f-395e-4410-aac9-85d3ea1b995a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:43.631511 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-36451a9f-395e-4410-aac9-85d3ea1b995a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:43.632286 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-36451a9f-395e-4410-aac9-85d3ea1b995a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:43.632720 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-36451a9f-395e-4410-aac9-85d3ea1b995a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:43.659445 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-88a83b44-f3a6-44e6-acc5-c362ac697017 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:43.667628 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-88a83b44-f3a6-44e6-acc5-c362ac697017 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150208 Jul 19 09:32:43.668205 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 479/931] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:43 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:43.765927 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-36451a9f-395e-4410-aac9-85d3ea1b995a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:43.775679 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-36451a9f-395e-4410-aac9-85d3ea1b995a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:43.777110 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-36451a9f-395e-4410-aac9-85d3ea1b995a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:43.778243 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-36451a9f-395e-4410-aac9-85d3ea1b995a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.157370 Jul 19 09:32:43.778837 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 453/932] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:43 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:44.684455 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2b20b613-ce57-4d44-9173-153c367eb0d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:44.685057 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2b20b613-ce57-4d44-9173-153c367eb0d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:44.690793 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2b20b613-ce57-4d44-9173-153c367eb0d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:44.691277 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2b20b613-ce57-4d44-9173-153c367eb0d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:44.692034 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2b20b613-ce57-4d44-9173-153c367eb0d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:44.692466 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2b20b613-ce57-4d44-9173-153c367eb0d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:44.797256 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b8446092-f951-4a7d-8e0c-e2a69ffb4451 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:44.797945 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b8446092-f951-4a7d-8e0c-e2a69ffb4451 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:44.804361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b8446092-f951-4a7d-8e0c-e2a69ffb4451 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:44.804872 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b8446092-f951-4a7d-8e0c-e2a69ffb4451 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:44.805698 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b8446092-f951-4a7d-8e0c-e2a69ffb4451 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:44.806196 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b8446092-f951-4a7d-8e0c-e2a69ffb4451 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:44.825233 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2b20b613-ce57-4d44-9173-153c367eb0d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:44.832661 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2b20b613-ce57-4d44-9173-153c367eb0d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151804 Jul 19 09:32:44.833229 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 480/933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:44 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:44.936551 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b8446092-f951-4a7d-8e0c-e2a69ffb4451 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:44.944606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b8446092-f951-4a7d-8e0c-e2a69ffb4451 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:44.946091 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b8446092-f951-4a7d-8e0c-e2a69ffb4451 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:44.947236 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b8446092-f951-4a7d-8e0c-e2a69ffb4451 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153594 Jul 19 09:32:44.947789 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 454/934] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:44 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:45.849173 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f25e2ead-daeb-4902-a32a-98f5cc065bf9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:45.850292 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f25e2ead-daeb-4902-a32a-98f5cc065bf9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:45.856082 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f25e2ead-daeb-4902-a32a-98f5cc065bf9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:45.856531 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f25e2ead-daeb-4902-a32a-98f5cc065bf9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:45.857290 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f25e2ead-daeb-4902-a32a-98f5cc065bf9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:45.857727 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f25e2ead-daeb-4902-a32a-98f5cc065bf9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:45.965055 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-914f7924-8c68-4caf-b341-0b3e50dde96e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:45.965668 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-914f7924-8c68-4caf-b341-0b3e50dde96e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:45.971347 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-914f7924-8c68-4caf-b341-0b3e50dde96e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:45.971804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-914f7924-8c68-4caf-b341-0b3e50dde96e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:45.972574 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-914f7924-8c68-4caf-b341-0b3e50dde96e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:45.973038 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-914f7924-8c68-4caf-b341-0b3e50dde96e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:45.986001 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f25e2ead-daeb-4902-a32a-98f5cc065bf9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:45.994036 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f25e2ead-daeb-4902-a32a-98f5cc065bf9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148458 Jul 19 09:32:45.994589 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 481/935] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:45 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:46.104011 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-914f7924-8c68-4caf-b341-0b3e50dde96e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:46.112056 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-914f7924-8c68-4caf-b341-0b3e50dde96e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:46.113581 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-914f7924-8c68-4caf-b341-0b3e50dde96e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:46.114721 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-914f7924-8c68-4caf-b341-0b3e50dde96e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153340 Jul 19 09:32:46.116056 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 455/936] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:45 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:47.011523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0801550a-93eb-47cc-8020-c868f40b1124 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:47.012126 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0801550a-93eb-47cc-8020-c868f40b1124 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:47.017818 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0801550a-93eb-47cc-8020-c868f40b1124 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:47.018269 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0801550a-93eb-47cc-8020-c868f40b1124 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:47.019024 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0801550a-93eb-47cc-8020-c868f40b1124 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:47.019479 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0801550a-93eb-47cc-8020-c868f40b1124 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:47.132685 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-be863ee2-9f6b-46ff-bcc5-0d852c1ee8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:47.133314 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-be863ee2-9f6b-46ff-bcc5-0d852c1ee8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:47.139291 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be863ee2-9f6b-46ff-bcc5-0d852c1ee8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:47.139742 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be863ee2-9f6b-46ff-bcc5-0d852c1ee8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:47.140493 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be863ee2-9f6b-46ff-bcc5-0d852c1ee8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:47.140929 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be863ee2-9f6b-46ff-bcc5-0d852c1ee8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:47.148875 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0801550a-93eb-47cc-8020-c868f40b1124 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:47.156069 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0801550a-93eb-47cc-8020-c868f40b1124 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148222 Jul 19 09:32:47.156636 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 482/937] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:47 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:47.276410 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-be863ee2-9f6b-46ff-bcc5-0d852c1ee8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:47.284910 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-be863ee2-9f6b-46ff-bcc5-0d852c1ee8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:47.286407 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-be863ee2-9f6b-46ff-bcc5-0d852c1ee8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:47.288256 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-be863ee2-9f6b-46ff-bcc5-0d852c1ee8e6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.159352 Jul 19 09:32:47.288806 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 456/938] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:47 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:48.173382 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f9085d22-8cf3-4bd7-a0cf-43c267cb1681 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:48.173990 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f9085d22-8cf3-4bd7-a0cf-43c267cb1681 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:48.180296 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9085d22-8cf3-4bd7-a0cf-43c267cb1681 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:48.180746 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9085d22-8cf3-4bd7-a0cf-43c267cb1681 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:48.181498 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9085d22-8cf3-4bd7-a0cf-43c267cb1681 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:48.181931 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9085d22-8cf3-4bd7-a0cf-43c267cb1681 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:48.306232 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f22a5097-389b-4612-8a19-0a7eb0373c44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:48.306901 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f22a5097-389b-4612-8a19-0a7eb0373c44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:48.312668 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f22a5097-389b-4612-8a19-0a7eb0373c44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:48.313128 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f22a5097-389b-4612-8a19-0a7eb0373c44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:48.313913 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f22a5097-389b-4612-8a19-0a7eb0373c44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:48.314355 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f22a5097-389b-4612-8a19-0a7eb0373c44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:48.317194 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f9085d22-8cf3-4bd7-a0cf-43c267cb1681 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:48.324468 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f9085d22-8cf3-4bd7-a0cf-43c267cb1681 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.154668 Jul 19 09:32:48.325043 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 483/939] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:48 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:48.446112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f22a5097-389b-4612-8a19-0a7eb0373c44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:48.454490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f22a5097-389b-4612-8a19-0a7eb0373c44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:48.456284 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f22a5097-389b-4612-8a19-0a7eb0373c44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:48.457427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f22a5097-389b-4612-8a19-0a7eb0373c44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.155812 Jul 19 09:32:48.457981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 457/940] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:48 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:49.342123 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-56eed1c6-e197-429f-ab56-5d68c8a932c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:49.342768 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-56eed1c6-e197-429f-ab56-5d68c8a932c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:49.348737 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-56eed1c6-e197-429f-ab56-5d68c8a932c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:49.349189 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-56eed1c6-e197-429f-ab56-5d68c8a932c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:49.349958 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-56eed1c6-e197-429f-ab56-5d68c8a932c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:49.350393 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-56eed1c6-e197-429f-ab56-5d68c8a932c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:49.475290 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b20c47eb-26a2-444c-a796-00a017efc832 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:49.475926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b20c47eb-26a2-444c-a796-00a017efc832 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:49.481747 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b20c47eb-26a2-444c-a796-00a017efc832 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:49.481970 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-56eed1c6-e197-429f-ab56-5d68c8a932c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:49.482194 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b20c47eb-26a2-444c-a796-00a017efc832 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:49.482962 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b20c47eb-26a2-444c-a796-00a017efc832 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:49.483423 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b20c47eb-26a2-444c-a796-00a017efc832 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:49.489319 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-56eed1c6-e197-429f-ab56-5d68c8a932c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150811 Jul 19 09:32:49.489884 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 484/941] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:49 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:49.616119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b20c47eb-26a2-444c-a796-00a017efc832 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:49.624719 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b20c47eb-26a2-444c-a796-00a017efc832 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:49.626212 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b20c47eb-26a2-444c-a796-00a017efc832 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:49.627372 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b20c47eb-26a2-444c-a796-00a017efc832 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.155702 Jul 19 09:32:49.627925 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 458/942] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:49 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:50.506529 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3245bab8-6ab1-4fc4-94b4-347ea21939a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:50.507321 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3245bab8-6ab1-4fc4-94b4-347ea21939a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:50.513048 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3245bab8-6ab1-4fc4-94b4-347ea21939a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:50.513491 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3245bab8-6ab1-4fc4-94b4-347ea21939a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:50.514248 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3245bab8-6ab1-4fc4-94b4-347ea21939a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:50.514677 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3245bab8-6ab1-4fc4-94b4-347ea21939a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:50.645879 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bbabf1ed-daa3-41b9-a60d-be9cfb94865c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:50.646484 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bbabf1ed-daa3-41b9-a60d-be9cfb94865c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:50.646847 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3245bab8-6ab1-4fc4-94b4-347ea21939a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:50.652879 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bbabf1ed-daa3-41b9-a60d-be9cfb94865c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:50.653320 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bbabf1ed-daa3-41b9-a60d-be9cfb94865c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:50.654087 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bbabf1ed-daa3-41b9-a60d-be9cfb94865c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:50.654515 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bbabf1ed-daa3-41b9-a60d-be9cfb94865c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:50.654672 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3245bab8-6ab1-4fc4-94b4-347ea21939a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151988 Jul 19 09:32:50.655266 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 485/943] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:50 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:50.784632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bbabf1ed-daa3-41b9-a60d-be9cfb94865c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:50.792843 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bbabf1ed-daa3-41b9-a60d-be9cfb94865c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:50.794324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bbabf1ed-daa3-41b9-a60d-be9cfb94865c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:50.795464 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bbabf1ed-daa3-41b9-a60d-be9cfb94865c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153352 Jul 19 09:32:50.796014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 459/944] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:50 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:51.671257 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e9707aab-2a78-4852-acb1-fac164534d7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:51.671862 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e9707aab-2a78-4852-acb1-fac164534d7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:51.677838 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9707aab-2a78-4852-acb1-fac164534d7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:51.678246 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9707aab-2a78-4852-acb1-fac164534d7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:51.679004 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9707aab-2a78-4852-acb1-fac164534d7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:51.679459 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9707aab-2a78-4852-acb1-fac164534d7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:51.808309 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e9707aab-2a78-4852-acb1-fac164534d7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:51.813063 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7a2a1e0d-b386-402a-b04f-88e9c59c62de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:51.813666 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7a2a1e0d-b386-402a-b04f-88e9c59c62de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:51.816316 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e9707aab-2a78-4852-acb1-fac164534d7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148715 Jul 19 09:32:51.816889 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 486/945] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:51 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:51.819324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7a2a1e0d-b386-402a-b04f-88e9c59c62de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:51.819769 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7a2a1e0d-b386-402a-b04f-88e9c59c62de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:51.820526 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7a2a1e0d-b386-402a-b04f-88e9c59c62de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:51.820956 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7a2a1e0d-b386-402a-b04f-88e9c59c62de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:51.951701 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7a2a1e0d-b386-402a-b04f-88e9c59c62de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:51.959891 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7a2a1e0d-b386-402a-b04f-88e9c59c62de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:51.961403 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7a2a1e0d-b386-402a-b04f-88e9c59c62de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:51.962535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7a2a1e0d-b386-402a-b04f-88e9c59c62de tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153629 Jul 19 09:32:51.963116 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 460/946] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:51 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:52.832936 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7703b373-1b06-48d7-a34d-5a51fccc9610 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:52.833467 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7703b373-1b06-48d7-a34d-5a51fccc9610 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:52.839378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7703b373-1b06-48d7-a34d-5a51fccc9610 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:52.839819 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7703b373-1b06-48d7-a34d-5a51fccc9610 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:52.840596 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7703b373-1b06-48d7-a34d-5a51fccc9610 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:52.841028 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7703b373-1b06-48d7-a34d-5a51fccc9610 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:52.968894 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7703b373-1b06-48d7-a34d-5a51fccc9610 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:52.976027 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7703b373-1b06-48d7-a34d-5a51fccc9610 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.146757 Jul 19 09:32:52.976730 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 487/947] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:52 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:52.980286 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-67b77bdf-2862-4eee-b84a-24f8df1da8ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:52.980899 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-67b77bdf-2862-4eee-b84a-24f8df1da8ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:52.986582 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-67b77bdf-2862-4eee-b84a-24f8df1da8ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:52.987066 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-67b77bdf-2862-4eee-b84a-24f8df1da8ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:52.987816 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-67b77bdf-2862-4eee-b84a-24f8df1da8ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:52.988247 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-67b77bdf-2862-4eee-b84a-24f8df1da8ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:53.119359 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-67b77bdf-2862-4eee-b84a-24f8df1da8ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:53.127916 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-67b77bdf-2862-4eee-b84a-24f8df1da8ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:53.129423 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-67b77bdf-2862-4eee-b84a-24f8df1da8ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:53.130545 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-67b77bdf-2862-4eee-b84a-24f8df1da8ee tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153890 Jul 19 09:32:53.131130 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 461/948] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:52 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:53.992401 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1ba30d25-d1e5-4d0e-9e9d-7d4e89a9350b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:53.993028 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1ba30d25-d1e5-4d0e-9e9d-7d4e89a9350b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:53.998759 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ba30d25-d1e5-4d0e-9e9d-7d4e89a9350b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:53.999240 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ba30d25-d1e5-4d0e-9e9d-7d4e89a9350b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:53.999990 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ba30d25-d1e5-4d0e-9e9d-7d4e89a9350b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:54.000417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ba30d25-d1e5-4d0e-9e9d-7d4e89a9350b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:54.131851 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1ba30d25-d1e5-4d0e-9e9d-7d4e89a9350b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:54.139574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1ba30d25-d1e5-4d0e-9e9d-7d4e89a9350b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150725 Jul 19 09:32:54.140139 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 488/949] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:53 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:54.147991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4130e500-bbd7-4e24-9723-e7dae895f3c9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:54.148603 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4130e500-bbd7-4e24-9723-e7dae895f3c9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:54.154912 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4130e500-bbd7-4e24-9723-e7dae895f3c9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:54.155388 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4130e500-bbd7-4e24-9723-e7dae895f3c9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:54.156177 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4130e500-bbd7-4e24-9723-e7dae895f3c9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:54.156611 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4130e500-bbd7-4e24-9723-e7dae895f3c9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:54.285036 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4130e500-bbd7-4e24-9723-e7dae895f3c9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:54.293562 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4130e500-bbd7-4e24-9723-e7dae895f3c9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:54.295086 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4130e500-bbd7-4e24-9723-e7dae895f3c9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:54.296218 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4130e500-bbd7-4e24-9723-e7dae895f3c9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.151922 Jul 19 09:32:54.296775 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 462/950] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:54 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:32:55.156275 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a5b37130-a2fa-41d6-b559-8e211aac7ce2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:55.156887 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a5b37130-a2fa-41d6-b559-8e211aac7ce2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:55.162708 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a5b37130-a2fa-41d6-b559-8e211aac7ce2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:55.163194 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a5b37130-a2fa-41d6-b559-8e211aac7ce2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:55.163958 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a5b37130-a2fa-41d6-b559-8e211aac7ce2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:55.164647 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a5b37130-a2fa-41d6-b559-8e211aac7ce2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:55.293650 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a5b37130-a2fa-41d6-b559-8e211aac7ce2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:55.301358 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a5b37130-a2fa-41d6-b559-8e211aac7ce2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148767 Jul 19 09:32:55.301917 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 489/951] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:55 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:55.313498 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-712ed178-352f-4d1d-b7f1-3fc2c7f3b9e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:55.314134 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-712ed178-352f-4d1d-b7f1-3fc2c7f3b9e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:55.319812 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-712ed178-352f-4d1d-b7f1-3fc2c7f3b9e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:55.320261 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-712ed178-352f-4d1d-b7f1-3fc2c7f3b9e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:55.321022 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-712ed178-352f-4d1d-b7f1-3fc2c7f3b9e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:55.321458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-712ed178-352f-4d1d-b7f1-3fc2c7f3b9e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:55.453184 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-712ed178-352f-4d1d-b7f1-3fc2c7f3b9e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:55.461276 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-712ed178-352f-4d1d-b7f1-3fc2c7f3b9e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:55.462779 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-712ed178-352f-4d1d-b7f1-3fc2c7f3b9e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:55.463926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-712ed178-352f-4d1d-b7f1-3fc2c7f3b9e0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154280 Jul 19 09:32:55.464482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 463/952] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:55 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:56.317492 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-23a1b2e0-f103-46b1-885b-2d742dd2303c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:56.318057 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-23a1b2e0-f103-46b1-885b-2d742dd2303c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:56.323722 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-23a1b2e0-f103-46b1-885b-2d742dd2303c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:56.324170 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-23a1b2e0-f103-46b1-885b-2d742dd2303c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:56.324912 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-23a1b2e0-f103-46b1-885b-2d742dd2303c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:56.325335 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-23a1b2e0-f103-46b1-885b-2d742dd2303c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:56.457690 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-23a1b2e0-f103-46b1-885b-2d742dd2303c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:56.464784 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-23a1b2e0-f103-46b1-885b-2d742dd2303c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151026 Jul 19 09:32:56.465341 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 490/953] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:56 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:56.481238 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f86dcb5e-bac3-492a-8bfa-4dd82217e7b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:56.482364 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f86dcb5e-bac3-492a-8bfa-4dd82217e7b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:56.488044 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f86dcb5e-bac3-492a-8bfa-4dd82217e7b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:56.488485 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f86dcb5e-bac3-492a-8bfa-4dd82217e7b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:56.489239 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f86dcb5e-bac3-492a-8bfa-4dd82217e7b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:56.489670 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f86dcb5e-bac3-492a-8bfa-4dd82217e7b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:56.617379 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f86dcb5e-bac3-492a-8bfa-4dd82217e7b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:56.626052 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f86dcb5e-bac3-492a-8bfa-4dd82217e7b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:56.627563 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f86dcb5e-bac3-492a-8bfa-4dd82217e7b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:56.628682 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f86dcb5e-bac3-492a-8bfa-4dd82217e7b9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.151097 Jul 19 09:32:56.629235 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 464/954] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:56 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:57.481262 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5a6b060c-70c6-410e-b4c8-d5dc1d50b695 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:57.481796 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5a6b060c-70c6-410e-b4c8-d5dc1d50b695 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:57.487516 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5a6b060c-70c6-410e-b4c8-d5dc1d50b695 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:57.487959 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5a6b060c-70c6-410e-b4c8-d5dc1d50b695 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:57.488707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5a6b060c-70c6-410e-b4c8-d5dc1d50b695 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:57.489131 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5a6b060c-70c6-410e-b4c8-d5dc1d50b695 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:57.618102 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5a6b060c-70c6-410e-b4c8-d5dc1d50b695 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:57.625772 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5a6b060c-70c6-410e-b4c8-d5dc1d50b695 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148170 Jul 19 09:32:57.626334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 491/955] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:57 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:57.646170 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8ab3c375-a488-46d1-8305-a76f3324a4ad tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:57.646788 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8ab3c375-a488-46d1-8305-a76f3324a4ad tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:57.652529 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8ab3c375-a488-46d1-8305-a76f3324a4ad tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:57.652979 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8ab3c375-a488-46d1-8305-a76f3324a4ad tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:57.653747 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8ab3c375-a488-46d1-8305-a76f3324a4ad tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:57.654182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8ab3c375-a488-46d1-8305-a76f3324a4ad tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:57.783499 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8ab3c375-a488-46d1-8305-a76f3324a4ad tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:57.791851 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8ab3c375-a488-46d1-8305-a76f3324a4ad tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:57.793366 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8ab3c375-a488-46d1-8305-a76f3324a4ad tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:57.794507 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8ab3c375-a488-46d1-8305-a76f3324a4ad tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.151990 Jul 19 09:32:57.795083 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 465/956] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:57 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:58.643310 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f2d6964b-3d30-48bf-a6c9-234bb5f1cb71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:58.643965 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f2d6964b-3d30-48bf-a6c9-234bb5f1cb71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:58.649715 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2d6964b-3d30-48bf-a6c9-234bb5f1cb71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:58.650168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2d6964b-3d30-48bf-a6c9-234bb5f1cb71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:58.650928 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2d6964b-3d30-48bf-a6c9-234bb5f1cb71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:58.651423 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2d6964b-3d30-48bf-a6c9-234bb5f1cb71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:58.778171 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f2d6964b-3d30-48bf-a6c9-234bb5f1cb71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:58.785418 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f2d6964b-3d30-48bf-a6c9-234bb5f1cb71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.145818 Jul 19 09:32:58.785974 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 492/957] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:58 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:32:58.812766 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0a066779-3a50-42b2-b8b1-ffc5629a5f8f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:58.813400 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0a066779-3a50-42b2-b8b1-ffc5629a5f8f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:58.819012 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0a066779-3a50-42b2-b8b1-ffc5629a5f8f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:58.819513 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0a066779-3a50-42b2-b8b1-ffc5629a5f8f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:58.820469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0a066779-3a50-42b2-b8b1-ffc5629a5f8f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:58.820691 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0a066779-3a50-42b2-b8b1-ffc5629a5f8f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:58.958483 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0a066779-3a50-42b2-b8b1-ffc5629a5f8f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:58.966586 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0a066779-3a50-42b2-b8b1-ffc5629a5f8f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:58.968129 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0a066779-3a50-42b2-b8b1-ffc5629a5f8f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:58.969257 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0a066779-3a50-42b2-b8b1-ffc5629a5f8f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.160765 Jul 19 09:32:58.969804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 466/958] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:58 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:32:59.802863 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-aec27355-c36b-4e0e-a794-7dfbc687eb2c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:59.803544 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-aec27355-c36b-4e0e-a794-7dfbc687eb2c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:59.809227 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aec27355-c36b-4e0e-a794-7dfbc687eb2c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:59.809680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aec27355-c36b-4e0e-a794-7dfbc687eb2c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:59.810430 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aec27355-c36b-4e0e-a794-7dfbc687eb2c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:59.810859 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aec27355-c36b-4e0e-a794-7dfbc687eb2c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:59.943881 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-aec27355-c36b-4e0e-a794-7dfbc687eb2c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:32:59.951355 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-aec27355-c36b-4e0e-a794-7dfbc687eb2c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152150 Jul 19 09:32:59.951928 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 493/959] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:32:59 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:32:59.987593 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6a701698-f9a5-4698-8f80-4f3f085a39fb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:32:59.988123 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6a701698-f9a5-4698-8f80-4f3f085a39fb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:32:59.994153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6a701698-f9a5-4698-8f80-4f3f085a39fb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:59.994607 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6a701698-f9a5-4698-8f80-4f3f085a39fb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:32:59.995441 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6a701698-f9a5-4698-8f80-4f3f085a39fb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:32:59.995877 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6a701698-f9a5-4698-8f80-4f3f085a39fb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:00.125847 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6a701698-f9a5-4698-8f80-4f3f085a39fb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:00.133992 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6a701698-f9a5-4698-8f80-4f3f085a39fb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:00.136250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6a701698-f9a5-4698-8f80-4f3f085a39fb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:00.137495 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6a701698-f9a5-4698-8f80-4f3f085a39fb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153591 Jul 19 09:33:00.138741 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 467/960] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:32:59 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:00.968114 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c807c28a-2f2a-47ed-b18d-69ee76dabbfc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:00.968732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c807c28a-2f2a-47ed-b18d-69ee76dabbfc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:00.974972 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c807c28a-2f2a-47ed-b18d-69ee76dabbfc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:00.975458 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c807c28a-2f2a-47ed-b18d-69ee76dabbfc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:00.976250 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c807c28a-2f2a-47ed-b18d-69ee76dabbfc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:00.976680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c807c28a-2f2a-47ed-b18d-69ee76dabbfc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:01.117343 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c807c28a-2f2a-47ed-b18d-69ee76dabbfc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:01.125929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c807c28a-2f2a-47ed-b18d-69ee76dabbfc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.161548 Jul 19 09:33:01.126503 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 494/961] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:00 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:01.155959 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a1810bf7-076b-414f-a5d4-0b55cbc5735a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:01.156591 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a1810bf7-076b-414f-a5d4-0b55cbc5735a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:01.162488 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a1810bf7-076b-414f-a5d4-0b55cbc5735a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:01.162886 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a1810bf7-076b-414f-a5d4-0b55cbc5735a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:01.163694 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a1810bf7-076b-414f-a5d4-0b55cbc5735a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:01.164381 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a1810bf7-076b-414f-a5d4-0b55cbc5735a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:01.298775 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a1810bf7-076b-414f-a5d4-0b55cbc5735a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:01.306786 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a1810bf7-076b-414f-a5d4-0b55cbc5735a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:01.308326 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a1810bf7-076b-414f-a5d4-0b55cbc5735a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:01.309432 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a1810bf7-076b-414f-a5d4-0b55cbc5735a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.157273 Jul 19 09:33:01.310477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 468/962] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:01 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:02.142544 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6edd2094-e304-433a-a31c-92fa21c2ec71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:02.143184 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6edd2094-e304-433a-a31c-92fa21c2ec71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:02.149104 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6edd2094-e304-433a-a31c-92fa21c2ec71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:02.149558 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6edd2094-e304-433a-a31c-92fa21c2ec71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:02.150349 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6edd2094-e304-433a-a31c-92fa21c2ec71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:02.150748 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6edd2094-e304-433a-a31c-92fa21c2ec71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:02.295215 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6edd2094-e304-433a-a31c-92fa21c2ec71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:02.302345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6edd2094-e304-433a-a31c-92fa21c2ec71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.163435 Jul 19 09:33:02.302913 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 495/963] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:02 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:02.327923 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7ac44739-925b-4f9f-90d1-62ccc9dd4b2b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:02.328534 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7ac44739-925b-4f9f-90d1-62ccc9dd4b2b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:02.334233 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ac44739-925b-4f9f-90d1-62ccc9dd4b2b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:02.334683 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ac44739-925b-4f9f-90d1-62ccc9dd4b2b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:02.335477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ac44739-925b-4f9f-90d1-62ccc9dd4b2b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:02.335923 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ac44739-925b-4f9f-90d1-62ccc9dd4b2b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:02.468235 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7ac44739-925b-4f9f-90d1-62ccc9dd4b2b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:02.476213 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7ac44739-925b-4f9f-90d1-62ccc9dd4b2b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:02.477709 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7ac44739-925b-4f9f-90d1-62ccc9dd4b2b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:02.478863 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7ac44739-925b-4f9f-90d1-62ccc9dd4b2b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154634 Jul 19 09:33:02.479459 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 469/964] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:02 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:03.318051 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5f87170a-8b94-43ab-8640-5320ec6300dd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:03.318657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5f87170a-8b94-43ab-8640-5320ec6300dd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:03.324351 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f87170a-8b94-43ab-8640-5320ec6300dd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:03.324800 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f87170a-8b94-43ab-8640-5320ec6300dd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:03.325556 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f87170a-8b94-43ab-8640-5320ec6300dd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:03.325989 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f87170a-8b94-43ab-8640-5320ec6300dd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:03.455955 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5f87170a-8b94-43ab-8640-5320ec6300dd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:03.463308 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5f87170a-8b94-43ab-8640-5320ec6300dd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148828 Jul 19 09:33:03.463865 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 496/965] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:03 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:03.496509 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-84bf68d6-5dc9-4ee8-8463-142bb9c6857d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:03.497711 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-84bf68d6-5dc9-4ee8-8463-142bb9c6857d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:03.503354 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-84bf68d6-5dc9-4ee8-8463-142bb9c6857d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:03.503796 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-84bf68d6-5dc9-4ee8-8463-142bb9c6857d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:03.504547 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-84bf68d6-5dc9-4ee8-8463-142bb9c6857d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:03.504975 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-84bf68d6-5dc9-4ee8-8463-142bb9c6857d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:03.633182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-84bf68d6-5dc9-4ee8-8463-142bb9c6857d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:03.641355 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-84bf68d6-5dc9-4ee8-8463-142bb9c6857d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:03.642858 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-84bf68d6-5dc9-4ee8-8463-142bb9c6857d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:03.644048 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-84bf68d6-5dc9-4ee8-8463-142bb9c6857d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.151264 Jul 19 09:33:03.644598 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 470/966] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:03 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:04.479820 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-58dca56d-b2dc-41bb-b2cb-7a4c9dff4e80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:04.480424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-58dca56d-b2dc-41bb-b2cb-7a4c9dff4e80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:04.486129 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-58dca56d-b2dc-41bb-b2cb-7a4c9dff4e80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:04.486574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-58dca56d-b2dc-41bb-b2cb-7a4c9dff4e80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:04.487357 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-58dca56d-b2dc-41bb-b2cb-7a4c9dff4e80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:04.487789 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-58dca56d-b2dc-41bb-b2cb-7a4c9dff4e80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:04.614687 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-58dca56d-b2dc-41bb-b2cb-7a4c9dff4e80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:04.622446 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-58dca56d-b2dc-41bb-b2cb-7a4c9dff4e80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.145771 Jul 19 09:33:04.623011 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 497/967] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:04 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:04.662851 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-87c28140-aa30-44b0-98af-9636bd7e160e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:04.663477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-87c28140-aa30-44b0-98af-9636bd7e160e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:04.669888 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-87c28140-aa30-44b0-98af-9636bd7e160e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:04.670328 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-87c28140-aa30-44b0-98af-9636bd7e160e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:04.671102 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-87c28140-aa30-44b0-98af-9636bd7e160e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:04.671534 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-87c28140-aa30-44b0-98af-9636bd7e160e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:04.802932 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-87c28140-aa30-44b0-98af-9636bd7e160e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:04.811611 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-87c28140-aa30-44b0-98af-9636bd7e160e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:04.813106 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-87c28140-aa30-44b0-98af-9636bd7e160e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:04.814253 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-87c28140-aa30-44b0-98af-9636bd7e160e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.155038 Jul 19 09:33:04.814798 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 471/968] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:04 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:05.639763 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-64e33bbd-f041-4f28-a94b-fa2eb1599d7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:05.640294 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-64e33bbd-f041-4f28-a94b-fa2eb1599d7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:05.646084 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-64e33bbd-f041-4f28-a94b-fa2eb1599d7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:05.646531 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-64e33bbd-f041-4f28-a94b-fa2eb1599d7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:05.647306 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-64e33bbd-f041-4f28-a94b-fa2eb1599d7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:05.647734 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-64e33bbd-f041-4f28-a94b-fa2eb1599d7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:05.778255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-64e33bbd-f041-4f28-a94b-fa2eb1599d7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:05.785443 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-64e33bbd-f041-4f28-a94b-fa2eb1599d7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150053 Jul 19 09:33:05.786006 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 498/969] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:05 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:05.831875 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b021f37b-aca0-40a1-b6c4-352f484888ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:05.832478 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b021f37b-aca0-40a1-b6c4-352f484888ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:05.838192 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b021f37b-aca0-40a1-b6c4-352f484888ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:05.838642 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b021f37b-aca0-40a1-b6c4-352f484888ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:05.839427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b021f37b-aca0-40a1-b6c4-352f484888ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:05.839864 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b021f37b-aca0-40a1-b6c4-352f484888ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:05.968187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b021f37b-aca0-40a1-b6c4-352f484888ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:05.976211 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b021f37b-aca0-40a1-b6c4-352f484888ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:05.977714 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b021f37b-aca0-40a1-b6c4-352f484888ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:05.978832 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b021f37b-aca0-40a1-b6c4-352f484888ab tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.150639 Jul 19 09:33:05.979408 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 472/970] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:05 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:06.802918 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3bae40fb-b443-4e2f-b97c-d17060c11c14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:06.803496 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3bae40fb-b443-4e2f-b97c-d17060c11c14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:06.809329 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3bae40fb-b443-4e2f-b97c-d17060c11c14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:06.809779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3bae40fb-b443-4e2f-b97c-d17060c11c14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:06.810541 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3bae40fb-b443-4e2f-b97c-d17060c11c14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:06.810977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3bae40fb-b443-4e2f-b97c-d17060c11c14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:06.939623 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3bae40fb-b443-4e2f-b97c-d17060c11c14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:06.946759 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3bae40fb-b443-4e2f-b97c-d17060c11c14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147551 Jul 19 09:33:06.947362 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 499/971] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:06 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:06.996896 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-aad2a467-09f1-4146-a508-abb6958e7708 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:06.997537 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-aad2a467-09f1-4146-a508-abb6958e7708 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:07.003209 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aad2a467-09f1-4146-a508-abb6958e7708 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:07.003660 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aad2a467-09f1-4146-a508-abb6958e7708 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:07.004420 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aad2a467-09f1-4146-a508-abb6958e7708 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:07.004852 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aad2a467-09f1-4146-a508-abb6958e7708 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:07.138603 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-aad2a467-09f1-4146-a508-abb6958e7708 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:07.146840 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-aad2a467-09f1-4146-a508-abb6958e7708 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:07.148382 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-aad2a467-09f1-4146-a508-abb6958e7708 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:07.149514 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-aad2a467-09f1-4146-a508-abb6958e7708 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156391 Jul 19 09:33:07.150068 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 473/972] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:06 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:07.963819 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e077654c-059d-47cd-9a1b-7eccf39534b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:07.964419 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e077654c-059d-47cd-9a1b-7eccf39534b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:07.970107 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e077654c-059d-47cd-9a1b-7eccf39534b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:07.970551 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e077654c-059d-47cd-9a1b-7eccf39534b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:07.971321 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e077654c-059d-47cd-9a1b-7eccf39534b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:07.971750 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e077654c-059d-47cd-9a1b-7eccf39534b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:08.103513 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e077654c-059d-47cd-9a1b-7eccf39534b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:08.111178 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e077654c-059d-47cd-9a1b-7eccf39534b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150976 Jul 19 09:33:08.111724 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 500/973] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:07 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:08.168329 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4e0da7ca-61fe-4ca8-bd2e-3b7e732cd937 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:08.169522 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4e0da7ca-61fe-4ca8-bd2e-3b7e732cd937 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:08.175328 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4e0da7ca-61fe-4ca8-bd2e-3b7e732cd937 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:08.175785 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4e0da7ca-61fe-4ca8-bd2e-3b7e732cd937 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:08.176557 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4e0da7ca-61fe-4ca8-bd2e-3b7e732cd937 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:08.176994 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4e0da7ca-61fe-4ca8-bd2e-3b7e732cd937 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:08.307282 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4e0da7ca-61fe-4ca8-bd2e-3b7e732cd937 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:08.315594 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4e0da7ca-61fe-4ca8-bd2e-3b7e732cd937 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:08.317097 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4e0da7ca-61fe-4ca8-bd2e-3b7e732cd937 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:08.318231 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4e0da7ca-61fe-4ca8-bd2e-3b7e732cd937 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153933 Jul 19 09:33:08.318787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 474/974] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:08 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:09.128279 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-257360de-08f6-48da-914d-6e54e8877d3a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:09.128881 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-257360de-08f6-48da-914d-6e54e8877d3a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:09.134671 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-257360de-08f6-48da-914d-6e54e8877d3a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:09.135148 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-257360de-08f6-48da-914d-6e54e8877d3a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:09.135903 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-257360de-08f6-48da-914d-6e54e8877d3a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:09.136332 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-257360de-08f6-48da-914d-6e54e8877d3a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:09.264859 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-257360de-08f6-48da-914d-6e54e8877d3a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:09.272002 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-257360de-08f6-48da-914d-6e54e8877d3a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147371 Jul 19 09:33:09.272564 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 501/975] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:09 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:09.335375 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-207eee92-a3de-41d7-8e8b-0cea0c6403ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:09.335983 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-207eee92-a3de-41d7-8e8b-0cea0c6403ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:09.341815 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-207eee92-a3de-41d7-8e8b-0cea0c6403ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:09.342263 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-207eee92-a3de-41d7-8e8b-0cea0c6403ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:09.343028 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-207eee92-a3de-41d7-8e8b-0cea0c6403ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:09.343482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-207eee92-a3de-41d7-8e8b-0cea0c6403ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:09.471636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-207eee92-a3de-41d7-8e8b-0cea0c6403ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:09.479634 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-207eee92-a3de-41d7-8e8b-0cea0c6403ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:09.481638 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-207eee92-a3de-41d7-8e8b-0cea0c6403ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:09.482760 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-207eee92-a3de-41d7-8e8b-0cea0c6403ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.151026 Jul 19 09:33:09.483350 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 475/976] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:09 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:10.287966 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-48342ed4-4813-44ad-a4d3-eb6a9fa2cc42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:10.288606 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-48342ed4-4813-44ad-a4d3-eb6a9fa2cc42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:10.294607 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-48342ed4-4813-44ad-a4d3-eb6a9fa2cc42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:10.295082 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-48342ed4-4813-44ad-a4d3-eb6a9fa2cc42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:10.295841 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-48342ed4-4813-44ad-a4d3-eb6a9fa2cc42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:10.296273 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-48342ed4-4813-44ad-a4d3-eb6a9fa2cc42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:10.426602 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-48342ed4-4813-44ad-a4d3-eb6a9fa2cc42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:10.433759 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-48342ed4-4813-44ad-a4d3-eb6a9fa2cc42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149448 Jul 19 09:33:10.434917 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 502/977] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:10 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:10.501086 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5ad2e67c-d9a2-429a-86cc-13891c5d199b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:10.501684 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5ad2e67c-d9a2-429a-86cc-13891c5d199b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:10.507340 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ad2e67c-d9a2-429a-86cc-13891c5d199b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:10.507791 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ad2e67c-d9a2-429a-86cc-13891c5d199b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:10.508544 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ad2e67c-d9a2-429a-86cc-13891c5d199b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:10.508974 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ad2e67c-d9a2-429a-86cc-13891c5d199b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:10.643561 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5ad2e67c-d9a2-429a-86cc-13891c5d199b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:10.651668 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5ad2e67c-d9a2-429a-86cc-13891c5d199b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:10.653178 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5ad2e67c-d9a2-429a-86cc-13891c5d199b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:10.654309 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5ad2e67c-d9a2-429a-86cc-13891c5d199b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.157528 Jul 19 09:33:10.654863 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 476/978] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:10 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:11.450671 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-46bab237-7e81-4710-91a5-402696602390 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:11.451296 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-46bab237-7e81-4710-91a5-402696602390 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:11.457014 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-46bab237-7e81-4710-91a5-402696602390 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:11.457458 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-46bab237-7e81-4710-91a5-402696602390 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:11.458211 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-46bab237-7e81-4710-91a5-402696602390 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:11.458634 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-46bab237-7e81-4710-91a5-402696602390 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:11.593332 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-46bab237-7e81-4710-91a5-402696602390 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:11.600571 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-46bab237-7e81-4710-91a5-402696602390 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.154075 Jul 19 09:33:11.601133 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 503/979] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:11 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:11.671724 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f717bd16-df54-4976-bb7c-4d2ca44d38b3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:11.672414 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f717bd16-df54-4976-bb7c-4d2ca44d38b3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:11.678021 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f717bd16-df54-4976-bb7c-4d2ca44d38b3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:11.678494 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f717bd16-df54-4976-bb7c-4d2ca44d38b3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:11.679431 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f717bd16-df54-4976-bb7c-4d2ca44d38b3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:11.679702 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f717bd16-df54-4976-bb7c-4d2ca44d38b3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:11.811892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f717bd16-df54-4976-bb7c-4d2ca44d38b3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:11.819835 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f717bd16-df54-4976-bb7c-4d2ca44d38b3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:11.821324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f717bd16-df54-4976-bb7c-4d2ca44d38b3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:11.822441 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f717bd16-df54-4976-bb7c-4d2ca44d38b3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154452 Jul 19 09:33:11.822997 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 477/980] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:11 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:12.617016 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0afd0bd8-5209-4f12-bc4e-512369302eda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:12.617643 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0afd0bd8-5209-4f12-bc4e-512369302eda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:12.623338 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0afd0bd8-5209-4f12-bc4e-512369302eda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:12.623784 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0afd0bd8-5209-4f12-bc4e-512369302eda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:12.624609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0afd0bd8-5209-4f12-bc4e-512369302eda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:12.625036 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0afd0bd8-5209-4f12-bc4e-512369302eda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:12.757874 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0afd0bd8-5209-4f12-bc4e-512369302eda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:12.765675 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0afd0bd8-5209-4f12-bc4e-512369302eda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152201 Jul 19 09:33:12.766254 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 504/981] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:12 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:12.841171 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6842b7b7-0077-438d-b9a0-69d451d214dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:12.841772 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6842b7b7-0077-438d-b9a0-69d451d214dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:12.847476 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6842b7b7-0077-438d-b9a0-69d451d214dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:12.847926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6842b7b7-0077-438d-b9a0-69d451d214dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:12.848684 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6842b7b7-0077-438d-b9a0-69d451d214dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:12.849121 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6842b7b7-0077-438d-b9a0-69d451d214dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:12.981782 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6842b7b7-0077-438d-b9a0-69d451d214dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:12.989792 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6842b7b7-0077-438d-b9a0-69d451d214dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:12.991335 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6842b7b7-0077-438d-b9a0-69d451d214dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:12.992463 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6842b7b7-0077-438d-b9a0-69d451d214dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.155438 Jul 19 09:33:12.993009 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 478/982] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:12 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:13.781641 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-fc95b6a7-cd45-4bf8-b79f-f3cb230c12f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:13.782272 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-fc95b6a7-cd45-4bf8-b79f-f3cb230c12f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:13.788004 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fc95b6a7-cd45-4bf8-b79f-f3cb230c12f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:13.788453 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fc95b6a7-cd45-4bf8-b79f-f3cb230c12f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:13.789461 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fc95b6a7-cd45-4bf8-b79f-f3cb230c12f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:13.789886 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fc95b6a7-cd45-4bf8-b79f-f3cb230c12f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:13.923148 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-fc95b6a7-cd45-4bf8-b79f-f3cb230c12f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:13.930287 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-fc95b6a7-cd45-4bf8-b79f-f3cb230c12f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152534 Jul 19 09:33:13.930854 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 505/983] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:13 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:14.009387 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a6d8d957-cc0b-4d55-ba02-2b7c9e6badcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:14.009994 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a6d8d957-cc0b-4d55-ba02-2b7c9e6badcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:14.015828 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a6d8d957-cc0b-4d55-ba02-2b7c9e6badcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:14.016279 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a6d8d957-cc0b-4d55-ba02-2b7c9e6badcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:14.017044 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a6d8d957-cc0b-4d55-ba02-2b7c9e6badcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:14.017478 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a6d8d957-cc0b-4d55-ba02-2b7c9e6badcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:14.146556 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a6d8d957-cc0b-4d55-ba02-2b7c9e6badcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:14.155200 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a6d8d957-cc0b-4d55-ba02-2b7c9e6badcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:14.156709 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a6d8d957-cc0b-4d55-ba02-2b7c9e6badcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:14.157843 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a6d8d957-cc0b-4d55-ba02-2b7c9e6badcd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.152169 Jul 19 09:33:14.158395 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 479/984] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:14 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:14.947111 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-40fd664f-c54c-4238-b1ce-4a734dddcd13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:14.947748 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-40fd664f-c54c-4238-b1ce-4a734dddcd13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:14.953978 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40fd664f-c54c-4238-b1ce-4a734dddcd13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:14.954424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40fd664f-c54c-4238-b1ce-4a734dddcd13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:14.955208 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40fd664f-c54c-4238-b1ce-4a734dddcd13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:14.955643 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40fd664f-c54c-4238-b1ce-4a734dddcd13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:15.085443 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-40fd664f-c54c-4238-b1ce-4a734dddcd13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:15.092688 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-40fd664f-c54c-4238-b1ce-4a734dddcd13 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149196 Jul 19 09:33:15.093251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 506/985] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:14 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:15.176374 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4d7f1047-c7e6-44c8-aa48-608dd45be6a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:15.177067 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4d7f1047-c7e6-44c8-aa48-608dd45be6a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:15.182885 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4d7f1047-c7e6-44c8-aa48-608dd45be6a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:15.183366 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4d7f1047-c7e6-44c8-aa48-608dd45be6a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:15.184715 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4d7f1047-c7e6-44c8-aa48-608dd45be6a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:15.185150 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4d7f1047-c7e6-44c8-aa48-608dd45be6a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:15.314706 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4d7f1047-c7e6-44c8-aa48-608dd45be6a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:15.322814 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4d7f1047-c7e6-44c8-aa48-608dd45be6a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:15.324354 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4d7f1047-c7e6-44c8-aa48-608dd45be6a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:15.325480 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4d7f1047-c7e6-44c8-aa48-608dd45be6a8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.152888 Jul 19 09:33:15.326025 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 480/986] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:15 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:16.109243 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b2ce93a7-9fc4-484b-82de-3b36f7fd07a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:16.109852 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b2ce93a7-9fc4-484b-82de-3b36f7fd07a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:16.115577 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b2ce93a7-9fc4-484b-82de-3b36f7fd07a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:16.116030 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b2ce93a7-9fc4-484b-82de-3b36f7fd07a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:16.116792 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b2ce93a7-9fc4-484b-82de-3b36f7fd07a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:16.117228 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b2ce93a7-9fc4-484b-82de-3b36f7fd07a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:16.247069 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b2ce93a7-9fc4-484b-82de-3b36f7fd07a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:16.254289 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b2ce93a7-9fc4-484b-82de-3b36f7fd07a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148712 Jul 19 09:33:16.254861 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 507/987] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:16 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:16.343327 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e26a1a60-e88f-48f8-a9a9-17d3ae0630ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:16.343934 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e26a1a60-e88f-48f8-a9a9-17d3ae0630ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:16.349657 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e26a1a60-e88f-48f8-a9a9-17d3ae0630ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:16.350099 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e26a1a60-e88f-48f8-a9a9-17d3ae0630ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:16.350859 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e26a1a60-e88f-48f8-a9a9-17d3ae0630ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:16.351313 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e26a1a60-e88f-48f8-a9a9-17d3ae0630ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:16.482559 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e26a1a60-e88f-48f8-a9a9-17d3ae0630ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:16.490611 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e26a1a60-e88f-48f8-a9a9-17d3ae0630ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:16.492157 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e26a1a60-e88f-48f8-a9a9-17d3ae0630ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:16.493281 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e26a1a60-e88f-48f8-a9a9-17d3ae0630ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153725 Jul 19 09:33:16.493834 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 481/988] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:16 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:17.271544 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5603adb6-e999-4838-8345-b37bc255e81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:17.272096 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5603adb6-e999-4838-8345-b37bc255e81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:17.278327 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5603adb6-e999-4838-8345-b37bc255e81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:17.278775 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5603adb6-e999-4838-8345-b37bc255e81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:17.279563 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5603adb6-e999-4838-8345-b37bc255e81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:17.279995 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5603adb6-e999-4838-8345-b37bc255e81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:17.413027 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5603adb6-e999-4838-8345-b37bc255e81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:17.420504 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5603adb6-e999-4838-8345-b37bc255e81c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152697 Jul 19 09:33:17.421071 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 508/989] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:17 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:17.511619 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-dfad7dfe-a069-4d72-82fc-aa0d6c6749c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:17.512721 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-dfad7dfe-a069-4d72-82fc-aa0d6c6749c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:17.518383 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dfad7dfe-a069-4d72-82fc-aa0d6c6749c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:17.518834 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dfad7dfe-a069-4d72-82fc-aa0d6c6749c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:17.519646 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dfad7dfe-a069-4d72-82fc-aa0d6c6749c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:17.520084 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dfad7dfe-a069-4d72-82fc-aa0d6c6749c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:17.648173 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-dfad7dfe-a069-4d72-82fc-aa0d6c6749c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:17.656953 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-dfad7dfe-a069-4d72-82fc-aa0d6c6749c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:17.658453 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-dfad7dfe-a069-4d72-82fc-aa0d6c6749c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:17.659614 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-dfad7dfe-a069-4d72-82fc-aa0d6c6749c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.151716 Jul 19 09:33:17.660174 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 482/990] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:17 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:18.437599 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-74e1dd47-2e9d-4284-bde7-bc69d633d04a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:18.438208 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-74e1dd47-2e9d-4284-bde7-bc69d633d04a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:18.444275 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-74e1dd47-2e9d-4284-bde7-bc69d633d04a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:18.444726 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-74e1dd47-2e9d-4284-bde7-bc69d633d04a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:18.445486 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-74e1dd47-2e9d-4284-bde7-bc69d633d04a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:18.445922 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-74e1dd47-2e9d-4284-bde7-bc69d633d04a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:18.574730 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-74e1dd47-2e9d-4284-bde7-bc69d633d04a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:18.581957 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-74e1dd47-2e9d-4284-bde7-bc69d633d04a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148560 Jul 19 09:33:18.582530 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 509/991] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:18 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:18.676613 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6e1508ab-8716-417f-aa1a-0b53cfe5ba54 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:18.677216 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6e1508ab-8716-417f-aa1a-0b53cfe5ba54 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:18.682981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e1508ab-8716-417f-aa1a-0b53cfe5ba54 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:18.683462 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e1508ab-8716-417f-aa1a-0b53cfe5ba54 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:18.684224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e1508ab-8716-417f-aa1a-0b53cfe5ba54 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:18.684657 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e1508ab-8716-417f-aa1a-0b53cfe5ba54 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:18.816121 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6e1508ab-8716-417f-aa1a-0b53cfe5ba54 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:18.824148 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6e1508ab-8716-417f-aa1a-0b53cfe5ba54 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:18.825656 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6e1508ab-8716-417f-aa1a-0b53cfe5ba54 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:18.826786 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6e1508ab-8716-417f-aa1a-0b53cfe5ba54 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153841 Jul 19 09:33:18.827390 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 483/992] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:18 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:19.598785 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ceedf203-675c-4574-890c-033f5bccf617 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:19.599407 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ceedf203-675c-4574-890c-033f5bccf617 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:19.605120 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ceedf203-675c-4574-890c-033f5bccf617 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:19.605558 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ceedf203-675c-4574-890c-033f5bccf617 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:19.606305 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ceedf203-675c-4574-890c-033f5bccf617 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:19.606730 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ceedf203-675c-4574-890c-033f5bccf617 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:19.738478 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ceedf203-675c-4574-890c-033f5bccf617 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:19.745602 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ceedf203-675c-4574-890c-033f5bccf617 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150434 Jul 19 09:33:19.746167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 510/993] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:19 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:19.844708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-056f1060-bcab-4f5b-a8d8-b9eae158d0b6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:19.845314 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-056f1060-bcab-4f5b-a8d8-b9eae158d0b6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:19.851109 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-056f1060-bcab-4f5b-a8d8-b9eae158d0b6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:19.851502 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-056f1060-bcab-4f5b-a8d8-b9eae158d0b6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:19.852261 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-056f1060-bcab-4f5b-a8d8-b9eae158d0b6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:19.852696 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-056f1060-bcab-4f5b-a8d8-b9eae158d0b6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:19.983063 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-056f1060-bcab-4f5b-a8d8-b9eae158d0b6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:19.991202 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-056f1060-bcab-4f5b-a8d8-b9eae158d0b6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:19.992700 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-056f1060-bcab-4f5b-a8d8-b9eae158d0b6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:19.993831 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-056f1060-bcab-4f5b-a8d8-b9eae158d0b6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.152811 Jul 19 09:33:19.994381 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 484/994] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:19 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:20.762805 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b6b14031-667a-4385-98a6-9498274d01b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:20.763442 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b6b14031-667a-4385-98a6-9498274d01b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:20.769202 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6b14031-667a-4385-98a6-9498274d01b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:20.769650 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6b14031-667a-4385-98a6-9498274d01b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:20.770413 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6b14031-667a-4385-98a6-9498274d01b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:20.770848 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b6b14031-667a-4385-98a6-9498274d01b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:20.899135 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b6b14031-667a-4385-98a6-9498274d01b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:20.906859 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b6b14031-667a-4385-98a6-9498274d01b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147687 Jul 19 09:33:20.907454 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 511/995] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:20 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:21.012161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-468d5c16-5417-444f-844e-ed5632cd84f2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:21.012768 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-468d5c16-5417-444f-844e-ed5632cd84f2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:21.018476 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-468d5c16-5417-444f-844e-ed5632cd84f2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:21.018876 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-468d5c16-5417-444f-844e-ed5632cd84f2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:21.019674 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-468d5c16-5417-444f-844e-ed5632cd84f2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:21.020122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-468d5c16-5417-444f-844e-ed5632cd84f2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:21.151884 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-468d5c16-5417-444f-844e-ed5632cd84f2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:21.160613 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-468d5c16-5417-444f-844e-ed5632cd84f2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:21.162288 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-468d5c16-5417-444f-844e-ed5632cd84f2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:21.163577 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-468d5c16-5417-444f-844e-ed5632cd84f2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.155114 Jul 19 09:33:21.164695 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 485/996] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:21 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:21.924460 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-39d4196b-2953-46ac-9cee-f8c45132878f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:21.925070 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-39d4196b-2953-46ac-9cee-f8c45132878f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:21.930882 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39d4196b-2953-46ac-9cee-f8c45132878f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:21.931370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39d4196b-2953-46ac-9cee-f8c45132878f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:21.932142 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39d4196b-2953-46ac-9cee-f8c45132878f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:21.932575 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39d4196b-2953-46ac-9cee-f8c45132878f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:22.062704 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-39d4196b-2953-46ac-9cee-f8c45132878f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:22.069997 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-39d4196b-2953-46ac-9cee-f8c45132878f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149284 Jul 19 09:33:22.070555 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 512/997] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:21 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:22.181542 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3b186e2a-8c9f-456e-8805-464f49034323 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:22.182078 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3b186e2a-8c9f-456e-8805-464f49034323 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:22.188525 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3b186e2a-8c9f-456e-8805-464f49034323 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:22.188984 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3b186e2a-8c9f-456e-8805-464f49034323 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:22.189747 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3b186e2a-8c9f-456e-8805-464f49034323 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:22.190187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3b186e2a-8c9f-456e-8805-464f49034323 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:22.324269 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3b186e2a-8c9f-456e-8805-464f49034323 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:22.332370 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3b186e2a-8c9f-456e-8805-464f49034323 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:22.333875 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3b186e2a-8c9f-456e-8805-464f49034323 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:22.334995 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3b186e2a-8c9f-456e-8805-464f49034323 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.157307 Jul 19 09:33:22.335572 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 486/998] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:22 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:23.085871 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-384ce55f-a19f-4479-b7b2-25f206ff3943 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:23.086594 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-384ce55f-a19f-4479-b7b2-25f206ff3943 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:23.092402 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-384ce55f-a19f-4479-b7b2-25f206ff3943 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:23.092854 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-384ce55f-a19f-4479-b7b2-25f206ff3943 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:23.093657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-384ce55f-a19f-4479-b7b2-25f206ff3943 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:23.094382 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-384ce55f-a19f-4479-b7b2-25f206ff3943 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:23.231025 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-384ce55f-a19f-4479-b7b2-25f206ff3943 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:23.238445 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-384ce55f-a19f-4479-b7b2-25f206ff3943 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.156552 Jul 19 09:33:23.239010 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 513/999] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:23 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:23.352881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-429d397d-9aff-4ff8-b2cf-5f72f3294a8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:23.353486 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-429d397d-9aff-4ff8-b2cf-5f72f3294a8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:23.359234 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-429d397d-9aff-4ff8-b2cf-5f72f3294a8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:23.359684 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-429d397d-9aff-4ff8-b2cf-5f72f3294a8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:23.360446 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-429d397d-9aff-4ff8-b2cf-5f72f3294a8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:23.360879 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-429d397d-9aff-4ff8-b2cf-5f72f3294a8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:23.493835 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-429d397d-9aff-4ff8-b2cf-5f72f3294a8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:23.502599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-429d397d-9aff-4ff8-b2cf-5f72f3294a8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:23.504123 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-429d397d-9aff-4ff8-b2cf-5f72f3294a8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:23.505255 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-429d397d-9aff-4ff8-b2cf-5f72f3294a8b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156101 Jul 19 09:33:23.505803 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 487/1000] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:23 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:24.255949 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-11f2b8de-9cc7-4c47-b0c2-521ca901b578 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:24.256561 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-11f2b8de-9cc7-4c47-b0c2-521ca901b578 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:24.262329 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-11f2b8de-9cc7-4c47-b0c2-521ca901b578 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:24.263300 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-11f2b8de-9cc7-4c47-b0c2-521ca901b578 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:24.264062 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-11f2b8de-9cc7-4c47-b0c2-521ca901b578 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:24.264496 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-11f2b8de-9cc7-4c47-b0c2-521ca901b578 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:24.394591 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-11f2b8de-9cc7-4c47-b0c2-521ca901b578 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:24.402118 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-11f2b8de-9cc7-4c47-b0c2-521ca901b578 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149802 Jul 19 09:33:24.402734 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 514/1001] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:24 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:24.523436 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ab136759-9d15-47f7-9b8e-848c4322dac4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:24.524039 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ab136759-9d15-47f7-9b8e-848c4322dac4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:24.529757 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ab136759-9d15-47f7-9b8e-848c4322dac4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:24.530198 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ab136759-9d15-47f7-9b8e-848c4322dac4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:24.530954 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ab136759-9d15-47f7-9b8e-848c4322dac4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:24.531410 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ab136759-9d15-47f7-9b8e-848c4322dac4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:24.663218 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ab136759-9d15-47f7-9b8e-848c4322dac4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:24.671572 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ab136759-9d15-47f7-9b8e-848c4322dac4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:24.673063 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ab136759-9d15-47f7-9b8e-848c4322dac4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:24.674175 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ab136759-9d15-47f7-9b8e-848c4322dac4 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154505 Jul 19 09:33:24.674723 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 488/1002] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:24 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:33:25.420330 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-21eeeb82-069c-4a28-af02-15843b99b075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:25.421043 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-21eeeb82-069c-4a28-af02-15843b99b075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:25.426708 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-21eeeb82-069c-4a28-af02-15843b99b075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:25.427195 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-21eeeb82-069c-4a28-af02-15843b99b075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:25.427963 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-21eeeb82-069c-4a28-af02-15843b99b075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:25.428402 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-21eeeb82-069c-4a28-af02-15843b99b075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:25.566708 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-21eeeb82-069c-4a28-af02-15843b99b075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:25.574117 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-21eeeb82-069c-4a28-af02-15843b99b075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.158179 Jul 19 09:33:25.574688 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 515/1003] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:25 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:25.692678 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a270584f-8edf-4483-8d2c-f2452270e2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:25.693208 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a270584f-8edf-4483-8d2c-f2452270e2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:25.698898 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a270584f-8edf-4483-8d2c-f2452270e2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:25.699378 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a270584f-8edf-4483-8d2c-f2452270e2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:25.700693 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a270584f-8edf-4483-8d2c-f2452270e2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:25.701126 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a270584f-8edf-4483-8d2c-f2452270e2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:25.832124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a270584f-8edf-4483-8d2c-f2452270e2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:25.840154 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a270584f-8edf-4483-8d2c-f2452270e2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:25.842296 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a270584f-8edf-4483-8d2c-f2452270e2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:25.843464 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a270584f-8edf-4483-8d2c-f2452270e2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154571 Jul 19 09:33:25.844020 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 489/1004] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:25 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:26.590663 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9b9347f6-b42e-4dae-95eb-3420eea8e4f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:26.591310 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9b9347f6-b42e-4dae-95eb-3420eea8e4f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:26.596985 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9b9347f6-b42e-4dae-95eb-3420eea8e4f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:26.597435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9b9347f6-b42e-4dae-95eb-3420eea8e4f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:26.598191 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9b9347f6-b42e-4dae-95eb-3420eea8e4f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:26.598625 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9b9347f6-b42e-4dae-95eb-3420eea8e4f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:26.726565 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9b9347f6-b42e-4dae-95eb-3420eea8e4f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:26.734221 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9b9347f6-b42e-4dae-95eb-3420eea8e4f5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147207 Jul 19 09:33:26.734783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 516/1005] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:26 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:26.861617 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-84d040de-c45e-4d09-ab9a-44b31c2eda93 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:26.862237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-84d040de-c45e-4d09-ab9a-44b31c2eda93 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:26.867866 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-84d040de-c45e-4d09-ab9a-44b31c2eda93 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:26.868311 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-84d040de-c45e-4d09-ab9a-44b31c2eda93 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:26.869064 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-84d040de-c45e-4d09-ab9a-44b31c2eda93 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:26.869491 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-84d040de-c45e-4d09-ab9a-44b31c2eda93 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:26.998671 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-84d040de-c45e-4d09-ab9a-44b31c2eda93 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:27.006857 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-84d040de-c45e-4d09-ab9a-44b31c2eda93 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:27.008371 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-84d040de-c45e-4d09-ab9a-44b31c2eda93 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:27.009487 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-84d040de-c45e-4d09-ab9a-44b31c2eda93 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.151535 Jul 19 09:33:27.010041 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 490/1006] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:26 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:33:27.750603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-23d0bab9-61e6-44bd-a134-ab3be8296bda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:27.751229 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-23d0bab9-61e6-44bd-a134-ab3be8296bda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:27.756952 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-23d0bab9-61e6-44bd-a134-ab3be8296bda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:27.757394 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-23d0bab9-61e6-44bd-a134-ab3be8296bda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:27.758142 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-23d0bab9-61e6-44bd-a134-ab3be8296bda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:27.758575 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-23d0bab9-61e6-44bd-a134-ab3be8296bda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:27.895507 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-23d0bab9-61e6-44bd-a134-ab3be8296bda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:27.902697 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-23d0bab9-61e6-44bd-a134-ab3be8296bda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.156225 Jul 19 09:33:27.903299 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 517/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:27 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:28.027602 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-08b69a46-5dcc-4ced-8a64-c2af60aa8f2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:28.028213 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-08b69a46-5dcc-4ced-8a64-c2af60aa8f2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:28.033985 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08b69a46-5dcc-4ced-8a64-c2af60aa8f2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:28.034442 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08b69a46-5dcc-4ced-8a64-c2af60aa8f2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:28.035239 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08b69a46-5dcc-4ced-8a64-c2af60aa8f2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:28.035949 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08b69a46-5dcc-4ced-8a64-c2af60aa8f2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:28.173936 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-08b69a46-5dcc-4ced-8a64-c2af60aa8f2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:28.182042 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-08b69a46-5dcc-4ced-8a64-c2af60aa8f2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:28.183561 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-08b69a46-5dcc-4ced-8a64-c2af60aa8f2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:28.185334 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-08b69a46-5dcc-4ced-8a64-c2af60aa8f2d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.162039 Jul 19 09:33:28.185886 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 491/1008] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:28 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:28.919682 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-720a701d-54d0-4393-8cf8-a1c74072c9a8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:28.920280 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-720a701d-54d0-4393-8cf8-a1c74072c9a8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:28.926047 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-720a701d-54d0-4393-8cf8-a1c74072c9a8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:28.926523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-720a701d-54d0-4393-8cf8-a1c74072c9a8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:28.927317 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-720a701d-54d0-4393-8cf8-a1c74072c9a8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:28.927746 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-720a701d-54d0-4393-8cf8-a1c74072c9a8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:29.059634 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-720a701d-54d0-4393-8cf8-a1c74072c9a8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:29.066828 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-720a701d-54d0-4393-8cf8-a1c74072c9a8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150748 Jul 19 09:33:29.067420 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 518/1009] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:28 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:29.203874 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cd6d6406-b85a-4949-a181-a89e2e6eedd8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:29.204479 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cd6d6406-b85a-4949-a181-a89e2e6eedd8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:29.210314 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cd6d6406-b85a-4949-a181-a89e2e6eedd8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:29.210759 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cd6d6406-b85a-4949-a181-a89e2e6eedd8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:29.211546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cd6d6406-b85a-4949-a181-a89e2e6eedd8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:29.211982 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cd6d6406-b85a-4949-a181-a89e2e6eedd8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:29.340447 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cd6d6406-b85a-4949-a181-a89e2e6eedd8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:29.348532 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cd6d6406-b85a-4949-a181-a89e2e6eedd8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:29.350031 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cd6d6406-b85a-4949-a181-a89e2e6eedd8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:29.351172 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cd6d6406-b85a-4949-a181-a89e2e6eedd8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.151541 Jul 19 09:33:29.351728 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 492/1010] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:29 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:30.084053 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-620dc3a4-acbf-4c96-9be2-a894e1b742fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:30.084653 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-620dc3a4-acbf-4c96-9be2-a894e1b742fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:30.091322 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-620dc3a4-acbf-4c96-9be2-a894e1b742fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:30.091774 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-620dc3a4-acbf-4c96-9be2-a894e1b742fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:30.092536 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-620dc3a4-acbf-4c96-9be2-a894e1b742fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:30.092969 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-620dc3a4-acbf-4c96-9be2-a894e1b742fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:30.227855 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-620dc3a4-acbf-4c96-9be2-a894e1b742fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:30.236535 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-620dc3a4-acbf-4c96-9be2-a894e1b742fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.156108 Jul 19 09:33:30.237221 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 519/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:30 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:30.369391 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-73091e9e-da8f-470c-b6ab-13004c72ca9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:30.369998 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-73091e9e-da8f-470c-b6ab-13004c72ca9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:30.375788 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-73091e9e-da8f-470c-b6ab-13004c72ca9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:30.376235 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-73091e9e-da8f-470c-b6ab-13004c72ca9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:30.377026 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-73091e9e-da8f-470c-b6ab-13004c72ca9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:30.377458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-73091e9e-da8f-470c-b6ab-13004c72ca9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:30.511480 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-73091e9e-da8f-470c-b6ab-13004c72ca9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:30.520752 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-73091e9e-da8f-470c-b6ab-13004c72ca9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:30.522240 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-73091e9e-da8f-470c-b6ab-13004c72ca9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:30.523400 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-73091e9e-da8f-470c-b6ab-13004c72ca9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.157646 Jul 19 09:33:30.523944 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 493/1012] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:30 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:31.253582 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-573cf278-bea9-4071-900d-891ab62d7358 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:31.254191 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-573cf278-bea9-4071-900d-891ab62d7358 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:31.259963 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-573cf278-bea9-4071-900d-891ab62d7358 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:31.260409 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-573cf278-bea9-4071-900d-891ab62d7358 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:31.261167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-573cf278-bea9-4071-900d-891ab62d7358 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:31.261598 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-573cf278-bea9-4071-900d-891ab62d7358 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:31.392534 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-573cf278-bea9-4071-900d-891ab62d7358 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:31.399709 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-573cf278-bea9-4071-900d-891ab62d7358 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149866 Jul 19 09:33:31.400279 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 520/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:31 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:31.542005 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6f1d25db-6f0d-425b-a807-b98fc3ab37bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:31.542459 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6f1d25db-6f0d-425b-a807-b98fc3ab37bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:31.548046 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6f1d25db-6f0d-425b-a807-b98fc3ab37bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:31.548490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6f1d25db-6f0d-425b-a807-b98fc3ab37bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:31.549242 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6f1d25db-6f0d-425b-a807-b98fc3ab37bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:31.549672 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6f1d25db-6f0d-425b-a807-b98fc3ab37bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:31.679670 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6f1d25db-6f0d-425b-a807-b98fc3ab37bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:31.688495 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6f1d25db-6f0d-425b-a807-b98fc3ab37bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:31.689999 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6f1d25db-6f0d-425b-a807-b98fc3ab37bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:31.691163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6f1d25db-6f0d-425b-a807-b98fc3ab37bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153620 Jul 19 09:33:31.691909 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 494/1014] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:31 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:32.417327 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e757b9bb-8586-4190-9701-1105456fdc93 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:32.417960 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e757b9bb-8586-4190-9701-1105456fdc93 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:32.423721 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e757b9bb-8586-4190-9701-1105456fdc93 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:32.424171 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e757b9bb-8586-4190-9701-1105456fdc93 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:32.424934 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e757b9bb-8586-4190-9701-1105456fdc93 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:32.425398 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e757b9bb-8586-4190-9701-1105456fdc93 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:32.557009 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e757b9bb-8586-4190-9701-1105456fdc93 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:32.564195 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e757b9bb-8586-4190-9701-1105456fdc93 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151011 Jul 19 09:33:32.564758 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 521/1015] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:32 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:32.709182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e402a251-a99b-477a-aec6-f35979a842fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:32.709744 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e402a251-a99b-477a-aec6-f35979a842fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:32.716078 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e402a251-a99b-477a-aec6-f35979a842fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:32.716525 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e402a251-a99b-477a-aec6-f35979a842fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:32.717284 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e402a251-a99b-477a-aec6-f35979a842fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:32.717718 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e402a251-a99b-477a-aec6-f35979a842fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:32.853745 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e402a251-a99b-477a-aec6-f35979a842fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:32.862094 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e402a251-a99b-477a-aec6-f35979a842fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:32.863631 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e402a251-a99b-477a-aec6-f35979a842fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:32.864756 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e402a251-a99b-477a-aec6-f35979a842fa tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.159402 Jul 19 09:33:32.865301 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 495/1016] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:32 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:33.581071 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9195ae4d-3962-47cd-89d6-acc4be2d7a34 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:33.581685 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9195ae4d-3962-47cd-89d6-acc4be2d7a34 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:33.587385 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9195ae4d-3962-47cd-89d6-acc4be2d7a34 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:33.587843 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9195ae4d-3962-47cd-89d6-acc4be2d7a34 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:33.588594 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9195ae4d-3962-47cd-89d6-acc4be2d7a34 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:33.589027 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9195ae4d-3962-47cd-89d6-acc4be2d7a34 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:33.720782 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9195ae4d-3962-47cd-89d6-acc4be2d7a34 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:33.728072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9195ae4d-3962-47cd-89d6-acc4be2d7a34 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150655 Jul 19 09:33:33.728650 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 522/1017] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:33 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:33.883101 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-992a01c5-7fac-46a0-b425-3294a1efd99d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:33.883721 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-992a01c5-7fac-46a0-b425-3294a1efd99d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:33.890295 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-992a01c5-7fac-46a0-b425-3294a1efd99d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:33.890754 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-992a01c5-7fac-46a0-b425-3294a1efd99d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:33.891566 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-992a01c5-7fac-46a0-b425-3294a1efd99d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:33.892247 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-992a01c5-7fac-46a0-b425-3294a1efd99d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:34.028918 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-992a01c5-7fac-46a0-b425-3294a1efd99d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:34.037186 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-992a01c5-7fac-46a0-b425-3294a1efd99d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:34.038664 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-992a01c5-7fac-46a0-b425-3294a1efd99d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:34.040085 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-992a01c5-7fac-46a0-b425-3294a1efd99d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.160680 Jul 19 09:33:34.040639 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 496/1018] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:33 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:34.745260 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a07746d6-c317-4af7-949c-b81765285c98 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:34.745923 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a07746d6-c317-4af7-949c-b81765285c98 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:34.752458 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a07746d6-c317-4af7-949c-b81765285c98 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:34.752944 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a07746d6-c317-4af7-949c-b81765285c98 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:34.753721 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a07746d6-c317-4af7-949c-b81765285c98 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:34.754156 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a07746d6-c317-4af7-949c-b81765285c98 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:34.888162 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a07746d6-c317-4af7-949c-b81765285c98 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:34.895707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a07746d6-c317-4af7-949c-b81765285c98 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.154096 Jul 19 09:33:34.896356 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 523/1019] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:34 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:35.058278 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2c23f8c5-afb1-496a-9f4a-1f2772d46a7f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:35.059170 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2c23f8c5-afb1-496a-9f4a-1f2772d46a7f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:35.065684 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2c23f8c5-afb1-496a-9f4a-1f2772d46a7f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:35.066133 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2c23f8c5-afb1-496a-9f4a-1f2772d46a7f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:35.066908 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2c23f8c5-afb1-496a-9f4a-1f2772d46a7f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:35.067412 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2c23f8c5-afb1-496a-9f4a-1f2772d46a7f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:35.145815 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:33:35.146059 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:33:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d (ip 10.222.0.16) !!! Jul 19 09:33:35.204058 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2c23f8c5-afb1-496a-9f4a-1f2772d46a7f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:35.212191 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2c23f8c5-afb1-496a-9f4a-1f2772d46a7f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:35.213707 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2c23f8c5-afb1-496a-9f4a-1f2772d46a7f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:35.215703 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2c23f8c5-afb1-496a-9f4a-1f2772d46a7f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.160516 Jul 19 09:33:35.216259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 497/1020] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:35 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:35.911222 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ee9ef09f-77b2-4dd6-8bf5-58d9558c0075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:35.911825 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ee9ef09f-77b2-4dd6-8bf5-58d9558c0075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:35.917770 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ee9ef09f-77b2-4dd6-8bf5-58d9558c0075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:35.918210 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ee9ef09f-77b2-4dd6-8bf5-58d9558c0075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:35.918962 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ee9ef09f-77b2-4dd6-8bf5-58d9558c0075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:35.919409 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ee9ef09f-77b2-4dd6-8bf5-58d9558c0075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:36.052745 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ee9ef09f-77b2-4dd6-8bf5-58d9558c0075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:36.060152 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ee9ef09f-77b2-4dd6-8bf5-58d9558c0075 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152495 Jul 19 09:33:36.061261 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 524/1021] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:35 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:36.234017 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b1524793-cd70-4ef8-b5f4-634ac3ba6f78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:36.234657 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b1524793-cd70-4ef8-b5f4-634ac3ba6f78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:36.240707 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1524793-cd70-4ef8-b5f4-634ac3ba6f78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:36.241162 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1524793-cd70-4ef8-b5f4-634ac3ba6f78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:36.241933 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1524793-cd70-4ef8-b5f4-634ac3ba6f78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:36.242375 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1524793-cd70-4ef8-b5f4-634ac3ba6f78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:36.488153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b1524793-cd70-4ef8-b5f4-634ac3ba6f78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:36.496373 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b1524793-cd70-4ef8-b5f4-634ac3ba6f78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:36.497910 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b1524793-cd70-4ef8-b5f4-634ac3ba6f78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:36.499092 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b1524793-cd70-4ef8-b5f4-634ac3ba6f78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.269243 Jul 19 09:33:36.499657 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 498/1022] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:36 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:33:37.077991 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8be9d4d5-9cbb-4726-a867-957c1ece94c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:37.078608 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8be9d4d5-9cbb-4726-a867-957c1ece94c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:37.084289 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8be9d4d5-9cbb-4726-a867-957c1ece94c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:37.084747 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8be9d4d5-9cbb-4726-a867-957c1ece94c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:37.085509 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8be9d4d5-9cbb-4726-a867-957c1ece94c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:37.085945 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8be9d4d5-9cbb-4726-a867-957c1ece94c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:37.221370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8be9d4d5-9cbb-4726-a867-957c1ece94c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:37.228615 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8be9d4d5-9cbb-4726-a867-957c1ece94c8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.154999 Jul 19 09:33:37.229178 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 525/1023] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:37 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:37.517971 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-450b4b08-a13f-4629-a5b4-64862fb040dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:37.518582 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-450b4b08-a13f-4629-a5b4-64862fb040dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:37.524377 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-450b4b08-a13f-4629-a5b4-64862fb040dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:37.524824 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-450b4b08-a13f-4629-a5b4-64862fb040dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:37.525595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-450b4b08-a13f-4629-a5b4-64862fb040dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:37.526032 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-450b4b08-a13f-4629-a5b4-64862fb040dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:37.655580 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-450b4b08-a13f-4629-a5b4-64862fb040dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:37.664052 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-450b4b08-a13f-4629-a5b4-64862fb040dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:37.665602 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-450b4b08-a13f-4629-a5b4-64862fb040dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:37.666741 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-450b4b08-a13f-4629-a5b4-64862fb040dc tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153136 Jul 19 09:33:37.667327 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 499/1024] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:37 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:38.245494 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-443fee64-3822-4948-bbc9-5d9d89fb31d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:38.246120 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-443fee64-3822-4948-bbc9-5d9d89fb31d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:38.252056 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-443fee64-3822-4948-bbc9-5d9d89fb31d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:38.252536 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-443fee64-3822-4948-bbc9-5d9d89fb31d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:38.253344 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-443fee64-3822-4948-bbc9-5d9d89fb31d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:38.253775 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-443fee64-3822-4948-bbc9-5d9d89fb31d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:38.384615 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-443fee64-3822-4948-bbc9-5d9d89fb31d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:38.392475 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-443fee64-3822-4948-bbc9-5d9d89fb31d8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150719 Jul 19 09:33:38.393037 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 526/1025] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:38 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:38.685753 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c90295c7-aaa1-4db6-adba-49c851afd823 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:38.686432 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c90295c7-aaa1-4db6-adba-49c851afd823 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:38.692244 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c90295c7-aaa1-4db6-adba-49c851afd823 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:38.692694 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c90295c7-aaa1-4db6-adba-49c851afd823 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:38.693456 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c90295c7-aaa1-4db6-adba-49c851afd823 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:38.693900 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c90295c7-aaa1-4db6-adba-49c851afd823 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:39.037177 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c90295c7-aaa1-4db6-adba-49c851afd823 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:39.045536 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c90295c7-aaa1-4db6-adba-49c851afd823 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:39.047071 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c90295c7-aaa1-4db6-adba-49c851afd823 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:39.048213 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c90295c7-aaa1-4db6-adba-49c851afd823 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.366744 Jul 19 09:33:39.048766 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 500/1026] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:38 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:39.409390 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5463d37c-c032-4ba1-ba47-08a4d3cb238e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:39.409928 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5463d37c-c032-4ba1-ba47-08a4d3cb238e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:39.415956 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5463d37c-c032-4ba1-ba47-08a4d3cb238e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:39.416402 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5463d37c-c032-4ba1-ba47-08a4d3cb238e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:39.417159 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5463d37c-c032-4ba1-ba47-08a4d3cb238e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:39.417590 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5463d37c-c032-4ba1-ba47-08a4d3cb238e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:39.564825 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5463d37c-c032-4ba1-ba47-08a4d3cb238e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:39.572052 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5463d37c-c032-4ba1-ba47-08a4d3cb238e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.166362 Jul 19 09:33:39.572620 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 527/1027] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:39 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:40.066473 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b7a041f5-d723-4464-8714-53890518db44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:40.067100 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b7a041f5-d723-4464-8714-53890518db44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:40.072964 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7a041f5-d723-4464-8714-53890518db44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:40.073406 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7a041f5-d723-4464-8714-53890518db44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:40.074172 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7a041f5-d723-4464-8714-53890518db44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:40.074602 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7a041f5-d723-4464-8714-53890518db44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:40.211318 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b7a041f5-d723-4464-8714-53890518db44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:40.221227 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b7a041f5-d723-4464-8714-53890518db44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:40.222873 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b7a041f5-d723-4464-8714-53890518db44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:40.224501 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b7a041f5-d723-4464-8714-53890518db44 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.161761 Jul 19 09:33:40.225126 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 501/1028] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:40 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:40.588706 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-51e397c5-b558-42c5-b93a-50426877660f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:40.589368 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-51e397c5-b558-42c5-b93a-50426877660f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:40.595644 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-51e397c5-b558-42c5-b93a-50426877660f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:40.596091 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-51e397c5-b558-42c5-b93a-50426877660f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:40.596856 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-51e397c5-b558-42c5-b93a-50426877660f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:40.597291 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-51e397c5-b558-42c5-b93a-50426877660f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:40.731686 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-51e397c5-b558-42c5-b93a-50426877660f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:40.738899 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-51e397c5-b558-42c5-b93a-50426877660f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.153902 Jul 19 09:33:40.739495 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 528/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:40 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:41.242691 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a0ade312-6f8a-4c8b-845b-7a9fda4e82d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:41.243338 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a0ade312-6f8a-4c8b-845b-7a9fda4e82d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:41.249324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a0ade312-6f8a-4c8b-845b-7a9fda4e82d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:41.249779 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a0ade312-6f8a-4c8b-845b-7a9fda4e82d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:41.250553 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a0ade312-6f8a-4c8b-845b-7a9fda4e82d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:41.250989 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a0ade312-6f8a-4c8b-845b-7a9fda4e82d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:41.384913 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a0ade312-6f8a-4c8b-845b-7a9fda4e82d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:41.393706 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a0ade312-6f8a-4c8b-845b-7a9fda4e82d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:41.395238 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a0ade312-6f8a-4c8b-845b-7a9fda4e82d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:41.396375 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a0ade312-6f8a-4c8b-845b-7a9fda4e82d0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.157415 Jul 19 09:33:41.396929 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 502/1030] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:41 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:41.756260 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5fdf011a-9773-4718-8ffb-d69f3638340c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:41.756899 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5fdf011a-9773-4718-8ffb-d69f3638340c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:41.762637 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5fdf011a-9773-4718-8ffb-d69f3638340c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:41.763114 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5fdf011a-9773-4718-8ffb-d69f3638340c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:41.764500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5fdf011a-9773-4718-8ffb-d69f3638340c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:41.764928 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5fdf011a-9773-4718-8ffb-d69f3638340c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:41.893404 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5fdf011a-9773-4718-8ffb-d69f3638340c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:41.900787 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5fdf011a-9773-4718-8ffb-d69f3638340c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148211 Jul 19 09:33:41.901355 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 529/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:41 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:42.415188 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e41e5852-4e67-4056-acc8-49852aabbb1b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:42.415775 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e41e5852-4e67-4056-acc8-49852aabbb1b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:42.422207 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e41e5852-4e67-4056-acc8-49852aabbb1b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:42.422652 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e41e5852-4e67-4056-acc8-49852aabbb1b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:42.423437 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e41e5852-4e67-4056-acc8-49852aabbb1b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:42.423864 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e41e5852-4e67-4056-acc8-49852aabbb1b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:42.554932 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e41e5852-4e67-4056-acc8-49852aabbb1b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:42.563395 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e41e5852-4e67-4056-acc8-49852aabbb1b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:42.564915 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e41e5852-4e67-4056-acc8-49852aabbb1b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:42.566075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e41e5852-4e67-4056-acc8-49852aabbb1b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.155236 Jul 19 09:33:42.566629 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 503/1032] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:42 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:42.917625 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-eb2dab16-935a-4d6c-84fd-7322129f81f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:42.918231 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-eb2dab16-935a-4d6c-84fd-7322129f81f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:42.923976 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eb2dab16-935a-4d6c-84fd-7322129f81f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:42.924424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eb2dab16-935a-4d6c-84fd-7322129f81f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:42.925179 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eb2dab16-935a-4d6c-84fd-7322129f81f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:42.925608 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eb2dab16-935a-4d6c-84fd-7322129f81f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:43.059420 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-eb2dab16-935a-4d6c-84fd-7322129f81f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:43.067837 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-eb2dab16-935a-4d6c-84fd-7322129f81f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.153804 Jul 19 09:33:43.068415 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 530/1033] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:42 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:43.583581 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b45de8e5-9d91-46b6-8690-6bbcc27fc4bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:43.584106 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b45de8e5-9d91-46b6-8690-6bbcc27fc4bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:43.590177 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b45de8e5-9d91-46b6-8690-6bbcc27fc4bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:43.590629 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b45de8e5-9d91-46b6-8690-6bbcc27fc4bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:43.591437 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b45de8e5-9d91-46b6-8690-6bbcc27fc4bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:43.591872 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b45de8e5-9d91-46b6-8690-6bbcc27fc4bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:43.722952 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b45de8e5-9d91-46b6-8690-6bbcc27fc4bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:43.731625 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b45de8e5-9d91-46b6-8690-6bbcc27fc4bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:43.733643 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b45de8e5-9d91-46b6-8690-6bbcc27fc4bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:43.734789 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b45de8e5-9d91-46b6-8690-6bbcc27fc4bb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154995 Jul 19 09:33:43.735370 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 504/1034] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:43 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:44.084414 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f549a5ab-54d6-4267-9c18-69544626afb9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:44.085061 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f549a5ab-54d6-4267-9c18-69544626afb9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:44.090904 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f549a5ab-54d6-4267-9c18-69544626afb9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:44.091884 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f549a5ab-54d6-4267-9c18-69544626afb9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:44.092643 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f549a5ab-54d6-4267-9c18-69544626afb9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:44.093073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f549a5ab-54d6-4267-9c18-69544626afb9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:44.225744 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f549a5ab-54d6-4267-9c18-69544626afb9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:44.233512 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f549a5ab-54d6-4267-9c18-69544626afb9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152282 Jul 19 09:33:44.234079 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 531/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:44 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:44.752964 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7bc65020-1802-4871-ae78-16042e92bf8d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:44.753568 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7bc65020-1802-4871-ae78-16042e92bf8d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:44.759372 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7bc65020-1802-4871-ae78-16042e92bf8d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:44.759819 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7bc65020-1802-4871-ae78-16042e92bf8d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:44.760582 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7bc65020-1802-4871-ae78-16042e92bf8d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:44.761019 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7bc65020-1802-4871-ae78-16042e92bf8d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:44.892749 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7bc65020-1802-4871-ae78-16042e92bf8d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:44.900856 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7bc65020-1802-4871-ae78-16042e92bf8d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:44.902400 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7bc65020-1802-4871-ae78-16042e92bf8d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:44.903561 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7bc65020-1802-4871-ae78-16042e92bf8d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154264 Jul 19 09:33:44.904112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 505/1036] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:44 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:45.249935 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7e2b97b3-ec21-4b58-b4cf-a6e339c18195 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:45.250540 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7e2b97b3-ec21-4b58-b4cf-a6e339c18195 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:45.256232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7e2b97b3-ec21-4b58-b4cf-a6e339c18195 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:45.259337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7e2b97b3-ec21-4b58-b4cf-a6e339c18195 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:45.259337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7e2b97b3-ec21-4b58-b4cf-a6e339c18195 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:45.259337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7e2b97b3-ec21-4b58-b4cf-a6e339c18195 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:45.392144 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7e2b97b3-ec21-4b58-b4cf-a6e339c18195 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:45.399533 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7e2b97b3-ec21-4b58-b4cf-a6e339c18195 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.153674 Jul 19 09:33:45.400055 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 532/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:45 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:45.922086 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ff2fb7eb-ba46-4502-9d58-76c48da9473e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:45.922692 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ff2fb7eb-ba46-4502-9d58-76c48da9473e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:45.928485 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ff2fb7eb-ba46-4502-9d58-76c48da9473e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:45.928929 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ff2fb7eb-ba46-4502-9d58-76c48da9473e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:45.929691 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ff2fb7eb-ba46-4502-9d58-76c48da9473e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:45.930125 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ff2fb7eb-ba46-4502-9d58-76c48da9473e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:46.059194 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ff2fb7eb-ba46-4502-9d58-76c48da9473e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:46.067859 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ff2fb7eb-ba46-4502-9d58-76c48da9473e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:46.069365 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ff2fb7eb-ba46-4502-9d58-76c48da9473e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:46.070490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ff2fb7eb-ba46-4502-9d58-76c48da9473e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.152625 Jul 19 09:33:46.071055 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 506/1038] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:45 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:46.416428 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1f17e1ed-45ee-47bc-97b7-419e523bf4ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:46.417055 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1f17e1ed-45ee-47bc-97b7-419e523bf4ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:46.422815 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1f17e1ed-45ee-47bc-97b7-419e523bf4ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:46.423297 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1f17e1ed-45ee-47bc-97b7-419e523bf4ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:46.424055 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1f17e1ed-45ee-47bc-97b7-419e523bf4ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:46.424487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1f17e1ed-45ee-47bc-97b7-419e523bf4ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:46.561732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1f17e1ed-45ee-47bc-97b7-419e523bf4ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:46.569048 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1f17e1ed-45ee-47bc-97b7-419e523bf4ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.156546 Jul 19 09:33:46.569603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 533/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:46 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:47.088504 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d20b0d28-7cfc-4718-923e-e76d847a225a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:47.089183 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d20b0d28-7cfc-4718-923e-e76d847a225a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:47.095533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d20b0d28-7cfc-4718-923e-e76d847a225a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:47.095983 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d20b0d28-7cfc-4718-923e-e76d847a225a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:47.096746 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d20b0d28-7cfc-4718-923e-e76d847a225a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:47.097180 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d20b0d28-7cfc-4718-923e-e76d847a225a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:47.230723 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d20b0d28-7cfc-4718-923e-e76d847a225a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:47.238892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d20b0d28-7cfc-4718-923e-e76d847a225a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:47.240422 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d20b0d28-7cfc-4718-923e-e76d847a225a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:47.241654 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d20b0d28-7cfc-4718-923e-e76d847a225a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156880 Jul 19 09:33:47.242221 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 507/1040] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:47 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:47.585786 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-42786b14-6835-41c7-a55e-e0b6dae68cf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:47.586389 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-42786b14-6835-41c7-a55e-e0b6dae68cf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:47.592189 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-42786b14-6835-41c7-a55e-e0b6dae68cf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:47.592575 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-42786b14-6835-41c7-a55e-e0b6dae68cf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:47.593334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-42786b14-6835-41c7-a55e-e0b6dae68cf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:47.593762 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-42786b14-6835-41c7-a55e-e0b6dae68cf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:47.724077 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-42786b14-6835-41c7-a55e-e0b6dae68cf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:47.731318 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-42786b14-6835-41c7-a55e-e0b6dae68cf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149174 Jul 19 09:33:47.732478 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 534/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:47 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:48.260062 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7c879f84-a592-467a-8596-bd958aac4096 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:48.260666 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7c879f84-a592-467a-8596-bd958aac4096 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:48.267001 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7c879f84-a592-467a-8596-bd958aac4096 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:48.267478 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7c879f84-a592-467a-8596-bd958aac4096 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:48.268239 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7c879f84-a592-467a-8596-bd958aac4096 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:48.268672 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7c879f84-a592-467a-8596-bd958aac4096 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:48.401630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7c879f84-a592-467a-8596-bd958aac4096 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:48.410339 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7c879f84-a592-467a-8596-bd958aac4096 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:48.411861 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7c879f84-a592-467a-8596-bd958aac4096 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:48.412988 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7c879f84-a592-467a-8596-bd958aac4096 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156683 Jul 19 09:33:48.413547 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 508/1042] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:48 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:48.673093 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:33:48.673568 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:33:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:33:48.749033 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-fde0b657-ad1b-434a-bf2f-d967378fa16c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:48.749748 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-fde0b657-ad1b-434a-bf2f-d967378fa16c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:48.755715 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fde0b657-ad1b-434a-bf2f-d967378fa16c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:48.756158 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fde0b657-ad1b-434a-bf2f-d967378fa16c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:48.756965 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fde0b657-ad1b-434a-bf2f-d967378fa16c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:48.757407 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fde0b657-ad1b-434a-bf2f-d967378fa16c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:48.890308 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-fde0b657-ad1b-434a-bf2f-d967378fa16c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:48.897431 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-fde0b657-ad1b-434a-bf2f-d967378fa16c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152572 Jul 19 09:33:48.897987 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 535/1043] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:48 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:49.431146 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4620e39f-a84a-43c7-908a-d152dbc67676 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:49.431683 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4620e39f-a84a-43c7-908a-d152dbc67676 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:49.437688 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4620e39f-a84a-43c7-908a-d152dbc67676 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:49.438138 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4620e39f-a84a-43c7-908a-d152dbc67676 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:49.439137 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4620e39f-a84a-43c7-908a-d152dbc67676 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:49.439396 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4620e39f-a84a-43c7-908a-d152dbc67676 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:49.567825 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4620e39f-a84a-43c7-908a-d152dbc67676 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:49.576419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4620e39f-a84a-43c7-908a-d152dbc67676 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:49.577919 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4620e39f-a84a-43c7-908a-d152dbc67676 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:49.579103 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4620e39f-a84a-43c7-908a-d152dbc67676 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.151705 Jul 19 09:33:49.579660 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 509/1044] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:49 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:49.913269 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b50055f1-fc85-4961-8010-2d1c14dbd50e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:49.914137 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b50055f1-fc85-4961-8010-2d1c14dbd50e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:49.920495 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b50055f1-fc85-4961-8010-2d1c14dbd50e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:49.920901 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b50055f1-fc85-4961-8010-2d1c14dbd50e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:49.921661 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b50055f1-fc85-4961-8010-2d1c14dbd50e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:49.922096 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b50055f1-fc85-4961-8010-2d1c14dbd50e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:50.050351 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b50055f1-fc85-4961-8010-2d1c14dbd50e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:50.057541 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b50055f1-fc85-4961-8010-2d1c14dbd50e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147919 Jul 19 09:33:50.058101 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 536/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:49 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:50.596283 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fd3bb343-4753-4c10-8bc4-74d6a93b012f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:50.596910 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fd3bb343-4753-4c10-8bc4-74d6a93b012f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:50.602757 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fd3bb343-4753-4c10-8bc4-74d6a93b012f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:50.603263 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fd3bb343-4753-4c10-8bc4-74d6a93b012f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:50.604027 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fd3bb343-4753-4c10-8bc4-74d6a93b012f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:50.604485 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fd3bb343-4753-4c10-8bc4-74d6a93b012f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:50.743179 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fd3bb343-4753-4c10-8bc4-74d6a93b012f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:50.751353 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fd3bb343-4753-4c10-8bc4-74d6a93b012f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:50.752855 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fd3bb343-4753-4c10-8bc4-74d6a93b012f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:50.753991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fd3bb343-4753-4c10-8bc4-74d6a93b012f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.161515 Jul 19 09:33:50.754550 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 510/1046] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:50 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:51.075070 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-11b6d99b-a501-4ee5-86e1-3fa7a6a5341a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:51.076221 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-11b6d99b-a501-4ee5-86e1-3fa7a6a5341a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:51.082003 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-11b6d99b-a501-4ee5-86e1-3fa7a6a5341a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:51.082452 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-11b6d99b-a501-4ee5-86e1-3fa7a6a5341a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:51.083524 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-11b6d99b-a501-4ee5-86e1-3fa7a6a5341a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:51.083961 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-11b6d99b-a501-4ee5-86e1-3fa7a6a5341a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:51.215843 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-11b6d99b-a501-4ee5-86e1-3fa7a6a5341a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:51.223024 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-11b6d99b-a501-4ee5-86e1-3fa7a6a5341a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151744 Jul 19 09:33:51.223610 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 537/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:51 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:51.772314 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-087498b5-8434-425a-8982-6a52b3f27ca3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:51.772763 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-087498b5-8434-425a-8982-6a52b3f27ca3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:51.779206 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-087498b5-8434-425a-8982-6a52b3f27ca3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:51.779696 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-087498b5-8434-425a-8982-6a52b3f27ca3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:51.780501 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-087498b5-8434-425a-8982-6a52b3f27ca3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:51.780942 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-087498b5-8434-425a-8982-6a52b3f27ca3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:51.914063 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-087498b5-8434-425a-8982-6a52b3f27ca3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:51.922221 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-087498b5-8434-425a-8982-6a52b3f27ca3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:51.923772 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-087498b5-8434-425a-8982-6a52b3f27ca3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:51.924908 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-087498b5-8434-425a-8982-6a52b3f27ca3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156706 Jul 19 09:33:51.932229 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 511/1048] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:51 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:52.240193 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a46b5ea9-2012-407b-a1d7-55f6d75f1227 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:52.240803 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a46b5ea9-2012-407b-a1d7-55f6d75f1227 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:52.246494 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a46b5ea9-2012-407b-a1d7-55f6d75f1227 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:52.246944 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a46b5ea9-2012-407b-a1d7-55f6d75f1227 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:52.248233 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a46b5ea9-2012-407b-a1d7-55f6d75f1227 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:52.248698 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a46b5ea9-2012-407b-a1d7-55f6d75f1227 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:52.378974 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a46b5ea9-2012-407b-a1d7-55f6d75f1227 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:52.386178 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a46b5ea9-2012-407b-a1d7-55f6d75f1227 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149608 Jul 19 09:33:52.386740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 538/1049] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:52 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:52.803253 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:33:52.803480 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:33:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:33:52.942371 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3e42a962-6537-4eb0-863a-af7c143d65ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:52.943006 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3e42a962-6537-4eb0-863a-af7c143d65ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:52.948687 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e42a962-6537-4eb0-863a-af7c143d65ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:52.949137 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e42a962-6537-4eb0-863a-af7c143d65ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:52.949896 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e42a962-6537-4eb0-863a-af7c143d65ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:52.950331 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e42a962-6537-4eb0-863a-af7c143d65ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:53.080803 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3e42a962-6537-4eb0-863a-af7c143d65ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:53.088901 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3e42a962-6537-4eb0-863a-af7c143d65ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:53.090417 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3e42a962-6537-4eb0-863a-af7c143d65ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:53.092059 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3e42a962-6537-4eb0-863a-af7c143d65ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.152818 Jul 19 09:33:53.092615 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 512/1050] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:52 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:53.403339 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7908589e-686d-4145-b5db-230398605e6d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:53.404512 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7908589e-686d-4145-b5db-230398605e6d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:53.410303 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7908589e-686d-4145-b5db-230398605e6d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:53.410753 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7908589e-686d-4145-b5db-230398605e6d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:53.411554 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7908589e-686d-4145-b5db-230398605e6d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:53.411993 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7908589e-686d-4145-b5db-230398605e6d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:53.540310 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7908589e-686d-4145-b5db-230398605e6d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:53.547431 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7908589e-686d-4145-b5db-230398605e6d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147703 Jul 19 09:33:53.547993 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 539/1051] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:53 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:54.110250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b88b14c0-6b69-418d-b43f-ddb87701a9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:54.111190 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b88b14c0-6b69-418d-b43f-ddb87701a9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:54.116994 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b88b14c0-6b69-418d-b43f-ddb87701a9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:54.117437 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b88b14c0-6b69-418d-b43f-ddb87701a9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:54.118190 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b88b14c0-6b69-418d-b43f-ddb87701a9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:54.118618 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b88b14c0-6b69-418d-b43f-ddb87701a9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:54.248102 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b88b14c0-6b69-418d-b43f-ddb87701a9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:54.256048 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b88b14c0-6b69-418d-b43f-ddb87701a9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:54.257562 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b88b14c0-6b69-418d-b43f-ddb87701a9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:54.258676 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b88b14c0-6b69-418d-b43f-ddb87701a9da tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.152722 Jul 19 09:33:54.259266 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 513/1052] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:54 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:54.563936 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bacfd429-1bd4-469f-9de6-8ede088b6922 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:54.564549 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bacfd429-1bd4-469f-9de6-8ede088b6922 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:54.570326 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bacfd429-1bd4-469f-9de6-8ede088b6922 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:54.570779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bacfd429-1bd4-469f-9de6-8ede088b6922 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:54.571569 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bacfd429-1bd4-469f-9de6-8ede088b6922 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:54.572004 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bacfd429-1bd4-469f-9de6-8ede088b6922 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:54.702835 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bacfd429-1bd4-469f-9de6-8ede088b6922 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:54.710029 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bacfd429-1bd4-469f-9de6-8ede088b6922 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149719 Jul 19 09:33:54.710586 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 540/1053] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:54 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:55.277020 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-37dc1c29-1688-4164-88c9-5a51ee2535be tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:55.277617 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-37dc1c29-1688-4164-88c9-5a51ee2535be tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:55.279894 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 09:33:55.284188 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-37dc1c29-1688-4164-88c9-5a51ee2535be tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:55.284632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-37dc1c29-1688-4164-88c9-5a51ee2535be tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:55.285379 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-37dc1c29-1688-4164-88c9-5a51ee2535be tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:55.285807 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-37dc1c29-1688-4164-88c9-5a51ee2535be tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:55.415668 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-37dc1c29-1688-4164-88c9-5a51ee2535be tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:55.424611 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-37dc1c29-1688-4164-88c9-5a51ee2535be tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:55.426311 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-37dc1c29-1688-4164-88c9-5a51ee2535be tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:55.427458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-37dc1c29-1688-4164-88c9-5a51ee2535be tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154115 Jul 19 09:33:55.428001 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 514/1054] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:55 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:55.726971 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7f68f7a9-277a-4747-84be-76498e194098 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:55.727546 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7f68f7a9-277a-4747-84be-76498e194098 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:55.733290 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7f68f7a9-277a-4747-84be-76498e194098 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:55.733747 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7f68f7a9-277a-4747-84be-76498e194098 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:55.734497 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7f68f7a9-277a-4747-84be-76498e194098 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:55.734928 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7f68f7a9-277a-4747-84be-76498e194098 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:55.865266 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7f68f7a9-277a-4747-84be-76498e194098 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:55.872346 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7f68f7a9-277a-4747-84be-76498e194098 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149053 Jul 19 09:33:55.872901 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 541/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:55 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:56.445219 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-71f85298-fb8d-4eb7-9479-63ad55c57e3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:56.445815 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-71f85298-fb8d-4eb7-9479-63ad55c57e3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:56.464492 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-71f85298-fb8d-4eb7-9479-63ad55c57e3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:56.464947 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-71f85298-fb8d-4eb7-9479-63ad55c57e3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:56.465716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-71f85298-fb8d-4eb7-9479-63ad55c57e3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:56.466153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-71f85298-fb8d-4eb7-9479-63ad55c57e3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:56.471970 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54318. Jul 19 09:33:56.600400 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-71f85298-fb8d-4eb7-9479-63ad55c57e3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:56.608635 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-71f85298-fb8d-4eb7-9479-63ad55c57e3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:56.610125 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-71f85298-fb8d-4eb7-9479-63ad55c57e3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:56.611271 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-71f85298-fb8d-4eb7-9479-63ad55c57e3e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.169743 Jul 19 09:33:56.611828 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 515/1056] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:56 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:56.891340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7309c9d4-e080-49f1-a229-9fb02ee909e4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:56.891953 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7309c9d4-e080-49f1-a229-9fb02ee909e4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:56.897664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7309c9d4-e080-49f1-a229-9fb02ee909e4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:56.898125 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7309c9d4-e080-49f1-a229-9fb02ee909e4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:56.898887 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7309c9d4-e080-49f1-a229-9fb02ee909e4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:56.899358 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7309c9d4-e080-49f1-a229-9fb02ee909e4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:57.031296 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7309c9d4-e080-49f1-a229-9fb02ee909e4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:57.039265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7309c9d4-e080-49f1-a229-9fb02ee909e4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151861 Jul 19 09:33:57.039909 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 542/1057] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:56 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:57.167275 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:33:57.167435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:33:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:33:57.628955 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bd6e6415-44da-4ba0-9b82-6c118cb44333 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:57.629498 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bd6e6415-44da-4ba0-9b82-6c118cb44333 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:57.635581 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd6e6415-44da-4ba0-9b82-6c118cb44333 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:57.636047 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd6e6415-44da-4ba0-9b82-6c118cb44333 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:57.636804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd6e6415-44da-4ba0-9b82-6c118cb44333 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:57.637228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd6e6415-44da-4ba0-9b82-6c118cb44333 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:57.769426 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bd6e6415-44da-4ba0-9b82-6c118cb44333 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:57.777399 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bd6e6415-44da-4ba0-9b82-6c118cb44333 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:57.778894 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bd6e6415-44da-4ba0-9b82-6c118cb44333 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:57.780539 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bd6e6415-44da-4ba0-9b82-6c118cb44333 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154882 Jul 19 09:33:57.781096 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 516/1058] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:57 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:58.056994 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-44ce482f-ad35-44a6-ae18-880c688b7590 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:58.057582 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-44ce482f-ad35-44a6-ae18-880c688b7590 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:58.064814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44ce482f-ad35-44a6-ae18-880c688b7590 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:58.065270 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44ce482f-ad35-44a6-ae18-880c688b7590 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:58.066075 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44ce482f-ad35-44a6-ae18-880c688b7590 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:58.066476 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44ce482f-ad35-44a6-ae18-880c688b7590 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:58.206905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-44ce482f-ad35-44a6-ae18-880c688b7590 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:58.214074 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-44ce482f-ad35-44a6-ae18-880c688b7590 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.161059 Jul 19 09:33:58.214629 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 543/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:58 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:58.798827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-75b804bf-260c-45d4-b432-2033d594a3d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:58.799466 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-75b804bf-260c-45d4-b432-2033d594a3d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:58.805208 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-75b804bf-260c-45d4-b432-2033d594a3d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:58.805650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-75b804bf-260c-45d4-b432-2033d594a3d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:58.806408 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-75b804bf-260c-45d4-b432-2033d594a3d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:58.806837 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-75b804bf-260c-45d4-b432-2033d594a3d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:58.941154 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-75b804bf-260c-45d4-b432-2033d594a3d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:58.949185 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-75b804bf-260c-45d4-b432-2033d594a3d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:58.950696 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-75b804bf-260c-45d4-b432-2033d594a3d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:58.951842 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-75b804bf-260c-45d4-b432-2033d594a3d3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156826 Jul 19 09:33:58.952396 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 517/1060] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:58 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:33:59.231389 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-75b9b8aa-7474-410d-97e2-0ffe9b4013d3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:59.232052 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-75b9b8aa-7474-410d-97e2-0ffe9b4013d3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:59.238313 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75b9b8aa-7474-410d-97e2-0ffe9b4013d3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:59.238762 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75b9b8aa-7474-410d-97e2-0ffe9b4013d3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:59.239555 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75b9b8aa-7474-410d-97e2-0ffe9b4013d3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:59.239991 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75b9b8aa-7474-410d-97e2-0ffe9b4013d3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:59.368249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-75b9b8aa-7474-410d-97e2-0ffe9b4013d3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:33:59.375603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-75b9b8aa-7474-410d-97e2-0ffe9b4013d3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147809 Jul 19 09:33:59.376166 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 544/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:33:59 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:33:59.968843 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e8028268-7e5f-4300-8cac-74ffbbcd004a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:33:59.969460 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e8028268-7e5f-4300-8cac-74ffbbcd004a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:33:59.975309 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e8028268-7e5f-4300-8cac-74ffbbcd004a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:59.975764 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e8028268-7e5f-4300-8cac-74ffbbcd004a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:33:59.976525 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e8028268-7e5f-4300-8cac-74ffbbcd004a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:33:59.976964 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e8028268-7e5f-4300-8cac-74ffbbcd004a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:00.108675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e8028268-7e5f-4300-8cac-74ffbbcd004a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:00.116979 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e8028268-7e5f-4300-8cac-74ffbbcd004a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:00.118494 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e8028268-7e5f-4300-8cac-74ffbbcd004a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:00.119671 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e8028268-7e5f-4300-8cac-74ffbbcd004a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154588 Jul 19 09:34:00.120229 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 518/1062] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:33:59 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:00.391969 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9317838a-ec4a-4a70-9ae5-c38721d8b732 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:00.392573 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9317838a-ec4a-4a70-9ae5-c38721d8b732 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:00.398306 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9317838a-ec4a-4a70-9ae5-c38721d8b732 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:00.398761 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9317838a-ec4a-4a70-9ae5-c38721d8b732 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:00.399550 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9317838a-ec4a-4a70-9ae5-c38721d8b732 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:00.399990 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9317838a-ec4a-4a70-9ae5-c38721d8b732 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:00.531598 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9317838a-ec4a-4a70-9ae5-c38721d8b732 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:00.539095 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9317838a-ec4a-4a70-9ae5-c38721d8b732 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150501 Jul 19 09:34:00.539657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 545/1063] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:00 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:01.137816 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-451ec1f6-dcf3-43ad-8a7a-d10740ffe1d2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:01.138426 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-451ec1f6-dcf3-43ad-8a7a-d10740ffe1d2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:01.144819 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-451ec1f6-dcf3-43ad-8a7a-d10740ffe1d2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:01.145272 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-451ec1f6-dcf3-43ad-8a7a-d10740ffe1d2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:01.146046 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-451ec1f6-dcf3-43ad-8a7a-d10740ffe1d2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:01.146487 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-451ec1f6-dcf3-43ad-8a7a-d10740ffe1d2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:01.282920 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-451ec1f6-dcf3-43ad-8a7a-d10740ffe1d2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:01.291415 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-451ec1f6-dcf3-43ad-8a7a-d10740ffe1d2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:01.292933 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-451ec1f6-dcf3-43ad-8a7a-d10740ffe1d2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:01.294065 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-451ec1f6-dcf3-43ad-8a7a-d10740ffe1d2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.160151 Jul 19 09:34:01.294653 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 519/1064] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:01 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:01.555605 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7bb2d021-17c6-4211-8f0f-809e256692e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:01.556126 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7bb2d021-17c6-4211-8f0f-809e256692e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:01.561838 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7bb2d021-17c6-4211-8f0f-809e256692e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:01.562286 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7bb2d021-17c6-4211-8f0f-809e256692e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:01.563605 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7bb2d021-17c6-4211-8f0f-809e256692e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:01.564041 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7bb2d021-17c6-4211-8f0f-809e256692e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:01.694918 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7bb2d021-17c6-4211-8f0f-809e256692e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:01.702136 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7bb2d021-17c6-4211-8f0f-809e256692e5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150329 Jul 19 09:34:01.702691 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 546/1065] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:01 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:02.311218 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c97920b4-5a12-4d16-a5b2-8fcb85ccc8e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:02.311828 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c97920b4-5a12-4d16-a5b2-8fcb85ccc8e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:02.318098 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c97920b4-5a12-4d16-a5b2-8fcb85ccc8e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:02.318546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c97920b4-5a12-4d16-a5b2-8fcb85ccc8e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:02.319330 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c97920b4-5a12-4d16-a5b2-8fcb85ccc8e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:02.327394 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c97920b4-5a12-4d16-a5b2-8fcb85ccc8e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:02.459241 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c97920b4-5a12-4d16-a5b2-8fcb85ccc8e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:02.467391 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c97920b4-5a12-4d16-a5b2-8fcb85ccc8e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:02.468896 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c97920b4-5a12-4d16-a5b2-8fcb85ccc8e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:02.470024 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c97920b4-5a12-4d16-a5b2-8fcb85ccc8e8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.162453 Jul 19 09:34:02.470575 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 520/1066] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:02 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:02.719691 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-727573f6-1bba-4ef1-9663-c3751c8fd468 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:02.720299 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-727573f6-1bba-4ef1-9663-c3751c8fd468 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:02.725967 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-727573f6-1bba-4ef1-9663-c3751c8fd468 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:02.726417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-727573f6-1bba-4ef1-9663-c3751c8fd468 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:02.727206 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-727573f6-1bba-4ef1-9663-c3751c8fd468 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:02.727636 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-727573f6-1bba-4ef1-9663-c3751c8fd468 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:02.855770 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-727573f6-1bba-4ef1-9663-c3751c8fd468 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:02.862975 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-727573f6-1bba-4ef1-9663-c3751c8fd468 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147361 Jul 19 09:34:02.863564 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 547/1067] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:02 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:03.488951 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3800ac08-9487-4159-92f1-2a113afffe0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:03.489568 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3800ac08-9487-4159-92f1-2a113afffe0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:03.495368 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3800ac08-9487-4159-92f1-2a113afffe0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:03.495825 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3800ac08-9487-4159-92f1-2a113afffe0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:03.496594 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3800ac08-9487-4159-92f1-2a113afffe0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:03.497034 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3800ac08-9487-4159-92f1-2a113afffe0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:03.627098 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3800ac08-9487-4159-92f1-2a113afffe0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:03.635140 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3800ac08-9487-4159-92f1-2a113afffe0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:03.636632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3800ac08-9487-4159-92f1-2a113afffe0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:03.637751 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3800ac08-9487-4159-92f1-2a113afffe0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153237 Jul 19 09:34:03.638305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 521/1068] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:03 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:03.880081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6a919c89-7029-4ee6-9942-94858682e319 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:03.880689 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6a919c89-7029-4ee6-9942-94858682e319 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:03.886363 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6a919c89-7029-4ee6-9942-94858682e319 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:03.886811 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6a919c89-7029-4ee6-9942-94858682e319 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:03.887595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6a919c89-7029-4ee6-9942-94858682e319 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:03.888025 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6a919c89-7029-4ee6-9942-94858682e319 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:04.019942 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6a919c89-7029-4ee6-9942-94858682e319 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:04.027223 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6a919c89-7029-4ee6-9942-94858682e319 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150717 Jul 19 09:34:04.027781 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 548/1069] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:03 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:04.655591 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6e170e29-d067-48e6-8ccf-10a3d0cfcda9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:04.656227 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6e170e29-d067-48e6-8ccf-10a3d0cfcda9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:04.662819 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e170e29-d067-48e6-8ccf-10a3d0cfcda9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:04.663299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e170e29-d067-48e6-8ccf-10a3d0cfcda9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:04.664320 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e170e29-d067-48e6-8ccf-10a3d0cfcda9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:04.664755 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e170e29-d067-48e6-8ccf-10a3d0cfcda9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:04.797405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6e170e29-d067-48e6-8ccf-10a3d0cfcda9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:04.805512 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6e170e29-d067-48e6-8ccf-10a3d0cfcda9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:04.807017 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6e170e29-d067-48e6-8ccf-10a3d0cfcda9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:04.808176 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6e170e29-d067-48e6-8ccf-10a3d0cfcda9 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156283 Jul 19 09:34:04.808745 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 522/1070] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:04 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:05.044217 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-15198651-67ad-4450-9880-7e4c3b7fd47e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:05.044775 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-15198651-67ad-4450-9880-7e4c3b7fd47e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:05.050485 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-15198651-67ad-4450-9880-7e4c3b7fd47e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:05.050933 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-15198651-67ad-4450-9880-7e4c3b7fd47e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:05.051719 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-15198651-67ad-4450-9880-7e4c3b7fd47e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:05.052150 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-15198651-67ad-4450-9880-7e4c3b7fd47e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:05.181943 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-15198651-67ad-4450-9880-7e4c3b7fd47e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:05.189604 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-15198651-67ad-4450-9880-7e4c3b7fd47e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149117 Jul 19 09:34:05.190155 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 549/1071] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:05 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:05.825952 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1c56dd26-7ced-4a38-9b53-70fbc51b0425 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:05.826560 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1c56dd26-7ced-4a38-9b53-70fbc51b0425 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:05.832343 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c56dd26-7ced-4a38-9b53-70fbc51b0425 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:05.832823 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c56dd26-7ced-4a38-9b53-70fbc51b0425 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:05.833586 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c56dd26-7ced-4a38-9b53-70fbc51b0425 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:05.834036 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c56dd26-7ced-4a38-9b53-70fbc51b0425 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:05.964770 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1c56dd26-7ced-4a38-9b53-70fbc51b0425 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:05.973380 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1c56dd26-7ced-4a38-9b53-70fbc51b0425 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:05.974892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1c56dd26-7ced-4a38-9b53-70fbc51b0425 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:05.976074 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1c56dd26-7ced-4a38-9b53-70fbc51b0425 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153832 Jul 19 09:34:05.976628 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 523/1072] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:05 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:06.205830 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0dbe2018-88b1-49df-96e3-46a8944269ea tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:06.206435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0dbe2018-88b1-49df-96e3-46a8944269ea tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:06.212214 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0dbe2018-88b1-49df-96e3-46a8944269ea tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:06.212661 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0dbe2018-88b1-49df-96e3-46a8944269ea tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:06.213412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0dbe2018-88b1-49df-96e3-46a8944269ea tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:06.213844 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0dbe2018-88b1-49df-96e3-46a8944269ea tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:06.348832 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0dbe2018-88b1-49df-96e3-46a8944269ea tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:06.356038 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0dbe2018-88b1-49df-96e3-46a8944269ea tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.154303 Jul 19 09:34:06.356604 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 550/1073] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:06 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:06.994439 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-52c3e074-5d04-47e7-a018-b60a48791a08 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:06.995068 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-52c3e074-5d04-47e7-a018-b60a48791a08 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:07.001462 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52c3e074-5d04-47e7-a018-b60a48791a08 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:07.001909 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52c3e074-5d04-47e7-a018-b60a48791a08 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:07.002671 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52c3e074-5d04-47e7-a018-b60a48791a08 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:07.003138 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-52c3e074-5d04-47e7-a018-b60a48791a08 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:07.133936 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-52c3e074-5d04-47e7-a018-b60a48791a08 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:07.142319 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-52c3e074-5d04-47e7-a018-b60a48791a08 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:07.143877 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-52c3e074-5d04-47e7-a018-b60a48791a08 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:07.145070 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-52c3e074-5d04-47e7-a018-b60a48791a08 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154272 Jul 19 09:34:07.145621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 524/1074] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:06 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:07.372314 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3b3aa7ea-e893-4e22-a2c1-b176734f8425 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:07.372846 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3b3aa7ea-e893-4e22-a2c1-b176734f8425 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:07.375289 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 09:34:07.379642 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3b3aa7ea-e893-4e22-a2c1-b176734f8425 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:07.380033 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3b3aa7ea-e893-4e22-a2c1-b176734f8425 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:07.380787 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3b3aa7ea-e893-4e22-a2c1-b176734f8425 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:07.381215 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3b3aa7ea-e893-4e22-a2c1-b176734f8425 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:07.509739 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3b3aa7ea-e893-4e22-a2c1-b176734f8425 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:07.517538 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3b3aa7ea-e893-4e22-a2c1-b176734f8425 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148887 Jul 19 09:34:07.518088 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 551/1075] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:07 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:08.163374 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ec003c51-e36b-4de6-84bd-5332ec175f2c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:08.164247 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ec003c51-e36b-4de6-84bd-5332ec175f2c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:08.170324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec003c51-e36b-4de6-84bd-5332ec175f2c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:08.170777 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec003c51-e36b-4de6-84bd-5332ec175f2c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:08.171588 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec003c51-e36b-4de6-84bd-5332ec175f2c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:08.172024 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec003c51-e36b-4de6-84bd-5332ec175f2c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:08.304546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ec003c51-e36b-4de6-84bd-5332ec175f2c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:08.313193 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ec003c51-e36b-4de6-84bd-5332ec175f2c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:08.314691 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ec003c51-e36b-4de6-84bd-5332ec175f2c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:08.315844 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ec003c51-e36b-4de6-84bd-5332ec175f2c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.156204 Jul 19 09:34:08.316409 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 525/1076] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:08 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:08.534070 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e9cc89b5-7cf3-44f0-9ff4-ffe924ebb45a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:08.534680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e9cc89b5-7cf3-44f0-9ff4-ffe924ebb45a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:08.551126 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9cc89b5-7cf3-44f0-9ff4-ffe924ebb45a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:08.551575 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9cc89b5-7cf3-44f0-9ff4-ffe924ebb45a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:08.552341 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9cc89b5-7cf3-44f0-9ff4-ffe924ebb45a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:08.552769 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9cc89b5-7cf3-44f0-9ff4-ffe924ebb45a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:08.558353 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54462. Jul 19 09:34:08.686154 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e9cc89b5-7cf3-44f0-9ff4-ffe924ebb45a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:08.693431 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e9cc89b5-7cf3-44f0-9ff4-ffe924ebb45a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.162922 Jul 19 09:34:08.694121 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 552/1077] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:08 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:09.334446 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a5a4198b-8ee3-45bd-89bf-90e021e5df0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:09.335068 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a5a4198b-8ee3-45bd-89bf-90e021e5df0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:09.340817 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a5a4198b-8ee3-45bd-89bf-90e021e5df0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:09.341259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a5a4198b-8ee3-45bd-89bf-90e021e5df0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:09.342007 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a5a4198b-8ee3-45bd-89bf-90e021e5df0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:09.342436 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a5a4198b-8ee3-45bd-89bf-90e021e5df0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:09.473014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a5a4198b-8ee3-45bd-89bf-90e021e5df0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:09.481096 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a5a4198b-8ee3-45bd-89bf-90e021e5df0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:09.482588 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a5a4198b-8ee3-45bd-89bf-90e021e5df0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:09.483820 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a5a4198b-8ee3-45bd-89bf-90e021e5df0e tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.153336 Jul 19 09:34:09.484935 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 526/1078] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:09 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:09.711030 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-44155956-04eb-48ab-8e2f-b6985d5919ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:09.711659 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-44155956-04eb-48ab-8e2f-b6985d5919ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:09.717432 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44155956-04eb-48ab-8e2f-b6985d5919ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:09.717894 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44155956-04eb-48ab-8e2f-b6985d5919ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:09.719179 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44155956-04eb-48ab-8e2f-b6985d5919ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:09.719751 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44155956-04eb-48ab-8e2f-b6985d5919ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:09.852041 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-44155956-04eb-48ab-8e2f-b6985d5919ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:09.859794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-44155956-04eb-48ab-8e2f-b6985d5919ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151823 Jul 19 09:34:09.860356 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 553/1079] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:09 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:10.502824 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-32c7d0d7-68a2-4a3b-b520-8bfc7c55bbc1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:10.503452 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-32c7d0d7-68a2-4a3b-b520-8bfc7c55bbc1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:10.509265 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32c7d0d7-68a2-4a3b-b520-8bfc7c55bbc1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:10.509707 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32c7d0d7-68a2-4a3b-b520-8bfc7c55bbc1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:10.510659 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32c7d0d7-68a2-4a3b-b520-8bfc7c55bbc1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:10.511127 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32c7d0d7-68a2-4a3b-b520-8bfc7c55bbc1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:10.644664 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-32c7d0d7-68a2-4a3b-b520-8bfc7c55bbc1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:10.652835 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-32c7d0d7-68a2-4a3b-b520-8bfc7c55bbc1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:10.654324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-32c7d0d7-68a2-4a3b-b520-8bfc7c55bbc1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:10.655496 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-32c7d0d7-68a2-4a3b-b520-8bfc7c55bbc1 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.157049 Jul 19 09:34:10.656044 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 527/1080] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:10 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:10.877045 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-024585f6-8330-4f9d-83d6-1ffab94dc80f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:10.877648 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-024585f6-8330-4f9d-83d6-1ffab94dc80f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:10.883282 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-024585f6-8330-4f9d-83d6-1ffab94dc80f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:10.883729 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-024585f6-8330-4f9d-83d6-1ffab94dc80f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:10.884483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-024585f6-8330-4f9d-83d6-1ffab94dc80f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:10.884916 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-024585f6-8330-4f9d-83d6-1ffab94dc80f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:11.013346 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-024585f6-8330-4f9d-83d6-1ffab94dc80f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:11.021113 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-024585f6-8330-4f9d-83d6-1ffab94dc80f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148352 Jul 19 09:34:11.021679 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 554/1081] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:10 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:11.673278 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7e691151-0421-4a1b-8ef9-5dd041ad16bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:11.673886 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7e691151-0421-4a1b-8ef9-5dd041ad16bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:11.679748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7e691151-0421-4a1b-8ef9-5dd041ad16bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:11.680202 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7e691151-0421-4a1b-8ef9-5dd041ad16bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:11.681002 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7e691151-0421-4a1b-8ef9-5dd041ad16bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:11.681437 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7e691151-0421-4a1b-8ef9-5dd041ad16bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:11.811687 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7e691151-0421-4a1b-8ef9-5dd041ad16bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:11.820171 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7e691151-0421-4a1b-8ef9-5dd041ad16bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:11.822009 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7e691151-0421-4a1b-8ef9-5dd041ad16bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:11.823180 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7e691151-0421-4a1b-8ef9-5dd041ad16bf tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.154128 Jul 19 09:34:11.823741 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 528/1082] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:11 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:12.037712 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bd416c70-c37e-4bde-80ff-f8e8af170281 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:12.038320 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bd416c70-c37e-4bde-80ff-f8e8af170281 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:12.044367 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bd416c70-c37e-4bde-80ff-f8e8af170281 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:12.044819 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bd416c70-c37e-4bde-80ff-f8e8af170281 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:12.045580 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bd416c70-c37e-4bde-80ff-f8e8af170281 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:12.046013 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bd416c70-c37e-4bde-80ff-f8e8af170281 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:12.179004 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bd416c70-c37e-4bde-80ff-f8e8af170281 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:12.186198 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bd416c70-c37e-4bde-80ff-f8e8af170281 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152111 Jul 19 09:34:12.186758 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 555/1083] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:12 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:12.841323 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bc1793f3-b75c-45bc-b711-f15343d8fc0b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:12.841931 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bc1793f3-b75c-45bc-b711-f15343d8fc0b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:12.848189 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc1793f3-b75c-45bc-b711-f15343d8fc0b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:12.848640 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc1793f3-b75c-45bc-b711-f15343d8fc0b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:12.849407 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc1793f3-b75c-45bc-b711-f15343d8fc0b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:12.849841 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc1793f3-b75c-45bc-b711-f15343d8fc0b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:12.981709 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bc1793f3-b75c-45bc-b711-f15343d8fc0b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:12.990394 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bc1793f3-b75c-45bc-b711-f15343d8fc0b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:12.991941 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bc1793f3-b75c-45bc-b711-f15343d8fc0b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:12.993073 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bc1793f3-b75c-45bc-b711-f15343d8fc0b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.155461 Jul 19 09:34:12.993628 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 529/1084] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:12 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:13.202821 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3f32c6da-2c2f-47f4-854b-d4a65da05237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:13.203510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3f32c6da-2c2f-47f4-854b-d4a65da05237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:13.209226 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3f32c6da-2c2f-47f4-854b-d4a65da05237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:13.209675 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3f32c6da-2c2f-47f4-854b-d4a65da05237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:13.210426 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3f32c6da-2c2f-47f4-854b-d4a65da05237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:13.210856 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3f32c6da-2c2f-47f4-854b-d4a65da05237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:13.338730 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3f32c6da-2c2f-47f4-854b-d4a65da05237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:13.346369 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3f32c6da-2c2f-47f4-854b-d4a65da05237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147158 Jul 19 09:34:13.346931 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 556/1085] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:13 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:14.011465 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8cbd8eb8-835d-4865-ac8b-c3603b20d346 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:14.012072 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8cbd8eb8-835d-4865-ac8b-c3603b20d346 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:14.018061 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8cbd8eb8-835d-4865-ac8b-c3603b20d346 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:14.018515 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8cbd8eb8-835d-4865-ac8b-c3603b20d346 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:14.019311 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8cbd8eb8-835d-4865-ac8b-c3603b20d346 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:14.019743 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8cbd8eb8-835d-4865-ac8b-c3603b20d346 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:14.154556 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8cbd8eb8-835d-4865-ac8b-c3603b20d346 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:14.162792 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8cbd8eb8-835d-4865-ac8b-c3603b20d346 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:14.164620 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8cbd8eb8-835d-4865-ac8b-c3603b20d346 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:14.165764 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8cbd8eb8-835d-4865-ac8b-c3603b20d346 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.157963 Jul 19 09:34:14.166313 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 530/1086] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:14 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:14.363235 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-00631fed-a1cf-4d00-96aa-a70ae1dc6f8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:14.363783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-00631fed-a1cf-4d00-96aa-a70ae1dc6f8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:14.369622 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-00631fed-a1cf-4d00-96aa-a70ae1dc6f8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:14.370070 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-00631fed-a1cf-4d00-96aa-a70ae1dc6f8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:14.370829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-00631fed-a1cf-4d00-96aa-a70ae1dc6f8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:14.371288 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-00631fed-a1cf-4d00-96aa-a70ae1dc6f8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:14.500585 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-00631fed-a1cf-4d00-96aa-a70ae1dc6f8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:14.507814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-00631fed-a1cf-4d00-96aa-a70ae1dc6f8d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148848 Jul 19 09:34:14.508366 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 557/1087] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:14 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:15.183525 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4cce2a34-3305-4e62-904f-fd8fd1c64ba8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:15.184163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4cce2a34-3305-4e62-904f-fd8fd1c64ba8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:15.190873 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4cce2a34-3305-4e62-904f-fd8fd1c64ba8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:15.191355 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4cce2a34-3305-4e62-904f-fd8fd1c64ba8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:15.192119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4cce2a34-3305-4e62-904f-fd8fd1c64ba8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:15.192554 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4cce2a34-3305-4e62-904f-fd8fd1c64ba8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:15.321641 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4cce2a34-3305-4e62-904f-fd8fd1c64ba8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:15.330091 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4cce2a34-3305-4e62-904f-fd8fd1c64ba8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:15.331600 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4cce2a34-3305-4e62-904f-fd8fd1c64ba8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:15.332714 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4cce2a34-3305-4e62-904f-fd8fd1c64ba8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.152880 Jul 19 09:34:15.333259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 531/1088] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:15 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:15.524792 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-159d8419-a759-4cdb-8601-70815c0662fc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:15.525400 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-159d8419-a759-4cdb-8601-70815c0662fc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:15.531154 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-159d8419-a759-4cdb-8601-70815c0662fc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:15.531609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-159d8419-a759-4cdb-8601-70815c0662fc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:15.532373 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-159d8419-a759-4cdb-8601-70815c0662fc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:15.532863 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-159d8419-a759-4cdb-8601-70815c0662fc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:15.663855 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-159d8419-a759-4cdb-8601-70815c0662fc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:15.670977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-159d8419-a759-4cdb-8601-70815c0662fc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149790 Jul 19 09:34:15.671582 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 558/1089] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:15 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:16.116443 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7ca6f5e9-944e-4e22-97b1-b168e172195e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:16.117025 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7ca6f5e9-944e-4e22-97b1-b168e172195e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:16.122768 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ca6f5e9-944e-4e22-97b1-b168e172195e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:16.123318 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ca6f5e9-944e-4e22-97b1-b168e172195e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:16.124074 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ca6f5e9-944e-4e22-97b1-b168e172195e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:16.124542 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ca6f5e9-944e-4e22-97b1-b168e172195e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:16.210590 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.objects.instance [None req-7ca6f5e9-944e-4e22-97b1-b168e172195e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lazy-loading 'services' on Instance uuid 36be7eb9-715d-4855-9896-49929b6d5013 {{(pid=107464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:34:16.272763 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7ca6f5e9-944e-4e22-97b1-b168e172195e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "DELETE /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013/os-volume_attachments/956e0791-2a92-44c6-9e30-290abe9a4696" status: 202 len: 0 microversion: 2.1 time: 0.159832 Jul 19 09:34:16.273332 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 532/1090] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Jul 19 09:34:16 2021] DELETE /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013/os-volume_attachments/956e0791-2a92-44c6-9e30-290abe9a4696 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:34:16.350888 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3312195a-53d7-41b4-a9be-2520c0eefd9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:16.351536 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3312195a-53d7-41b4-a9be-2520c0eefd9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:16.357233 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3312195a-53d7-41b4-a9be-2520c0eefd9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:16.357681 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3312195a-53d7-41b4-a9be-2520c0eefd9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:16.358450 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3312195a-53d7-41b4-a9be-2520c0eefd9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:16.359432 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3312195a-53d7-41b4-a9be-2520c0eefd9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:16.486430 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3312195a-53d7-41b4-a9be-2520c0eefd9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:16.494423 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3312195a-53d7-41b4-a9be-2520c0eefd9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:16.495944 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3312195a-53d7-41b4-a9be-2520c0eefd9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:16.497064 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3312195a-53d7-41b4-a9be-2520c0eefd9b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 200 len: 1745 microversion: 2.20 time: 0.150280 Jul 19 09:34:16.497613 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 559/1091] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:16 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:16.579156 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b7de537b-2177-4e96-bab3-6a593568fc76 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:16.579673 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b7de537b-2177-4e96-bab3-6a593568fc76 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:16.585529 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7de537b-2177-4e96-bab3-6a593568fc76 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:16.585972 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7de537b-2177-4e96-bab3-6a593568fc76 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:16.586724 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7de537b-2177-4e96-bab3-6a593568fc76 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:16.587188 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7de537b-2177-4e96-bab3-6a593568fc76 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:16.688316 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5f8f7f79-05e3-433c-8e6d-9a8b7ef8958b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:16.688993 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5f8f7f79-05e3-433c-8e6d-9a8b7ef8958b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:16.695072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f8f7f79-05e3-433c-8e6d-9a8b7ef8958b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:16.695516 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f8f7f79-05e3-433c-8e6d-9a8b7ef8958b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:16.696275 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f8f7f79-05e3-433c-8e6d-9a8b7ef8958b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:16.696701 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f8f7f79-05e3-433c-8e6d-9a8b7ef8958b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:16.815246 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b7de537b-2177-4e96-bab3-6a593568fc76 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/os-volume_attachments/615754e5-4564-44ba-a138-8465684d2db4" status: 202 len: 0 microversion: 2.20 time: 0.240628 Jul 19 09:34:16.815943 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 533/1092] 10.222.0.16 () {60 vars in 1457 bytes} [Mon Jul 19 09:34:16 2021] DELETE /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d/os-volume_attachments/615754e5-4564-44ba-a138-8465684d2db4 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 09:34:16.878246 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:16.878743 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:16.884665 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:16.885112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:16.885892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:16.886322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:16.913012 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Going to try to terminate instance {{(pid=107464) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:34:16.919819 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.compute.api [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Working on deleting snapshot a2255835-42c0-48f4-96bc-6dc0bbb5be9d from shelved instance... Jul 19 09:34:17.029193 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5f8f7f79-05e3-433c-8e6d-9a8b7ef8958b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:17.038906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5f8f7f79-05e3-433c-8e6d-9a8b7ef8958b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.354002 Jul 19 09:34:17.039510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 560/1093] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:16 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:34:17.446770 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Doing local delete in cell 15c05796-47fc-4258-ab4c-71158a7062ab(cell1) {{(pid=107464) _delete /opt/stack/nova/nova/compute/api.py:2367}} Jul 19 09:34:17.447604 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:17.448054 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:17.448478 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.compute.api [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 19 09:34:17.455675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.network.neutron [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] deallocate_for_instance() {{(pid=107464) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1543}} Jul 19 09:34:18.056515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-465dc3a6-9704-46f9-9338-c0775e15ec80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:18.057282 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-465dc3a6-9704-46f9-9338-c0775e15ec80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:18.063807 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-465dc3a6-9704-46f9-9338-c0775e15ec80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:18.064259 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-465dc3a6-9704-46f9-9338-c0775e15ec80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:18.065037 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-465dc3a6-9704-46f9-9338-c0775e15ec80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:18.065457 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-465dc3a6-9704-46f9-9338-c0775e15ec80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:18.223920 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-465dc3a6-9704-46f9-9338-c0775e15ec80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:18.236135 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-465dc3a6-9704-46f9-9338-c0775e15ec80 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.183183 Jul 19 09:34:18.237500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 561/1094] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:18 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:34:18.450193 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.network.neutron [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Updating instance_info_cache with network_info: [] {{(pid=107464) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Jul 19 09:34:18.511939 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-999fb76e-df77-4576-a180-2af10b0ec497 req-2b9b12a0-42a1-49f3-8f2f-62c55e542ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cbcf278-5d96-4715-9238-5dd27d17311d", "name": "network-vif-deleted", "tag": "d8df4a87-cd9e-43a5-9d1d-ace9278bf484"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:18.513562 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:34:18.513562 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:34:18.520800 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-999fb76e-df77-4576-a180-2af10b0ec497 req-2b9b12a0-42a1-49f3-8f2f-62c55e542ecb service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:18.521212 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-999fb76e-df77-4576-a180-2af10b0ec497 req-2b9b12a0-42a1-49f3-8f2f-62c55e542ecb service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:18.532603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.compute.server_external_events [req-999fb76e-df77-4576-a180-2af10b0ec497 req-2b9b12a0-42a1-49f3-8f2f-62c55e542ecb service nova] Unable to find a host for instance 5cbcf278-5d96-4715-9238-5dd27d17311d. Dropping event network-vif-deleted {{(pid=107463) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jul 19 09:34:18.533474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-999fb76e-df77-4576-a180-2af10b0ec497 req-2b9b12a0-42a1-49f3-8f2f-62c55e542ecb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.085886 Jul 19 09:34:18.534240 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 562/1095] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:34:18 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 19 09:34:18.689258 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.scheduler.client.report [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Deleted allocation for instance 5cbcf278-5d96-4715-9238-5dd27d17311d Jul 19 09:34:18.813243 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f35f0ac4-2f45-4afe-9e1b-6e8307c1f2a3 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 204 len: 0 microversion: 2.20 time: 1.939122 Jul 19 09:34:18.813821 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 534/1096] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Jul 19 09:34:16 2021] DELETE /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 0 bytes in 1940 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 09:34:18.822012 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-48d744d9-1ef6-413f-9e98-4dec92d7f6c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:18.822616 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-48d744d9-1ef6-413f-9e98-4dec92d7f6c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:18.828347 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-48d744d9-1ef6-413f-9e98-4dec92d7f6c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:18.828799 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-48d744d9-1ef6-413f-9e98-4dec92d7f6c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:18.829556 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-48d744d9-1ef6-413f-9e98-4dec92d7f6c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:18.829986 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-48d744d9-1ef6-413f-9e98-4dec92d7f6c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:18.842760 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-48d744d9-1ef6-413f-9e98-4dec92d7f6c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] HTTP exception thrown: Instance 5cbcf278-5d96-4715-9238-5dd27d17311d could not be found. Jul 19 09:34:18.843434 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-48d744d9-1ef6-413f-9e98-4dec92d7f6c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Returning 404 to user: Instance 5cbcf278-5d96-4715-9238-5dd27d17311d could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:34:18.844201 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-48d744d9-1ef6-413f-9e98-4dec92d7f6c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 404 len: 111 microversion: 2.20 time: 0.025959 Jul 19 09:34:18.848051 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 563/1097] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:18 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 09:34:18.853448 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6c11c112-dbfb-4eed-86d2-7c827ba75ac8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '.version_select at 0x7f04b026da60>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:18.872145 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6c11c112-dbfb-4eed-86d2-7c827ba75ac8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-965080508" status: 204 len: 0 microversion: 2.20 time: 0.022613 Jul 19 09:34:18.872716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 535/1098] 10.222.0.16 () {60 vars in 1259 bytes} [Mon Jul 19 09:34:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-965080508 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 09:34:19.253038 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9dce00b2-1a4c-4f67-8826-fd4624defe28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:19.253807 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9dce00b2-1a4c-4f67-8826-fd4624defe28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:19.260474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9dce00b2-1a4c-4f67-8826-fd4624defe28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:19.261016 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9dce00b2-1a4c-4f67-8826-fd4624defe28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:19.261888 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9dce00b2-1a4c-4f67-8826-fd4624defe28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:19.262414 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9dce00b2-1a4c-4f67-8826-fd4624defe28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:19.415669 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9dce00b2-1a4c-4f67-8826-fd4624defe28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:19.424164 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9dce00b2-1a4c-4f67-8826-fd4624defe28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.174983 Jul 19 09:34:19.424815 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 564/1099] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:19 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:19.618057 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b740c45c-cafc-4d91-97f2-3b89b3474315 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'create', calling method: .version_select at 0x7f04b01d7820>, body: {"keypair": {"name": "tempest-keypair-2105244001"}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:19.636130 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-b740c45c-cafc-4d91-97f2-3b89b3474315 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Getting quotas for project 2498b582b7bb4eca8ff9411d45786967. Resources: {'key_pairs'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:34:19.639944 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-b740c45c-cafc-4d91-97f2-3b89b3474315 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Getting quotas for user 96ccfe87d4084f299d97fa417b248d82 and project 2498b582b7bb4eca8ff9411d45786967. Resources: {'key_pairs'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:34:19.946006 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-b740c45c-cafc-4d91-97f2-3b89b3474315 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Getting quotas for project 2498b582b7bb4eca8ff9411d45786967. Resources: {'key_pairs'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:34:19.949748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-b740c45c-cafc-4d91-97f2-3b89b3474315 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Getting quotas for user 96ccfe87d4084f299d97fa417b248d82 and project 2498b582b7bb4eca8ff9411d45786967. Resources: {'key_pairs'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:34:19.962561 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b740c45c-cafc-4d91-97f2-3b89b3474315 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.348312 Jul 19 09:34:19.963491 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 536/1100] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Jul 19 09:34:19 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 350 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jul 19 09:34:20.441579 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f6d122a9-a272-45f6-b36b-3830f66971df tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:20.442188 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f6d122a9-a272-45f6-b36b-3830f66971df tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:20.448029 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6d122a9-a272-45f6-b36b-3830f66971df tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:20.448573 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6d122a9-a272-45f6-b36b-3830f66971df tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:20.449356 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6d122a9-a272-45f6-b36b-3830f66971df tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:20.449793 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6d122a9-a272-45f6-b36b-3830f66971df tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:20.585539 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f6d122a9-a272-45f6-b36b-3830f66971df tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:20.593018 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f6d122a9-a272-45f6-b36b-3830f66971df tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.155055 Jul 19 09:34:20.593583 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 565/1101] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:20 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:21.418572 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-752915753", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1445ca09-c3c3-4dc5-bdc4-b66e9118991f"}], "security_groups": [{"name": "tempest-securitygroup--140600259"}], "key_name": "tempest-keypair-2105244001", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:21.511305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.network.neutron [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] validate_networks() for [('1445ca09-c3c3-4dc5-bdc4-b66e9118991f', None, None, None)] {{(pid=107464) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:34:21.610914 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-25524684-37ba-408e-a86c-ea233122c0da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:21.611655 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-25524684-37ba-408e-a86c-ea233122c0da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:21.622094 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-25524684-37ba-408e-a86c-ea233122c0da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:21.622094 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-25524684-37ba-408e-a86c-ea233122c0da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:21.622094 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-25524684-37ba-408e-a86c-ea233122c0da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:21.622094 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-25524684-37ba-408e-a86c-ea233122c0da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:21.753279 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-25524684-37ba-408e-a86c-ea233122c0da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:21.760706 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-25524684-37ba-408e-a86c-ea233122c0da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.154157 Jul 19 09:34:21.761259 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 566/1102] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:21 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:21.929126 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Flavor limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:34:21.929556 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Image limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:34:21.930036 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Flavor pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:34:21.930449 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Image pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:34:21.930917 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:34:21.939469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:21.939923 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:21.940727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:21.941363 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:21.957961 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Getting quotas for project 2498b582b7bb4eca8ff9411d45786967. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:34:21.961751 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Getting quotas for user 96ccfe87d4084f299d97fa417b248d82 and project 2498b582b7bb4eca8ff9411d45786967. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:34:21.972794 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Going to run 1 instances... {{(pid=107464) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:34:21.975203 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:34:22.022333 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7ee14c9f-2545-47e5-8ab1-2affc0a5d91b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.607789 Jul 19 09:34:22.023003 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 537/1103] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Jul 19 09:34:21 2021] POST /compute/v2.1/servers => generated 401 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 09:34:22.033236 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e3d9ff6b-d737-4ac4-a401-0eb17a1d7863 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:22.033843 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e3d9ff6b-d737-4ac4-a401-0eb17a1d7863 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:22.085649 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e3d9ff6b-d737-4ac4-a401-0eb17a1d7863 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:22.092734 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e3d9ff6b-d737-4ac4-a401-0eb17a1d7863 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:22.094925 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e3d9ff6b-d737-4ac4-a401-0eb17a1d7863 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:22.096028 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e3d9ff6b-d737-4ac4-a401-0eb17a1d7863 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99" status: 200 len: 1281 microversion: 2.20 time: 0.067098 Jul 19 09:34:22.096575 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 567/1104] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:22 2021] GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:22.777396 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-159528f2-5188-45e0-be6b-4ee344a80d42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:22.777935 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-159528f2-5188-45e0-be6b-4ee344a80d42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:22.784914 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-159528f2-5188-45e0-be6b-4ee344a80d42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:22.785355 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-159528f2-5188-45e0-be6b-4ee344a80d42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:22.786105 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-159528f2-5188-45e0-be6b-4ee344a80d42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:22.786536 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-159528f2-5188-45e0-be6b-4ee344a80d42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:22.918371 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-159528f2-5188-45e0-be6b-4ee344a80d42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:22.925660 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-159528f2-5188-45e0-be6b-4ee344a80d42 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152005 Jul 19 09:34:22.926234 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 538/1105] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:22 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:23.113347 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-56890bc5-c584-4b7a-b4c3-16755cf85685 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:23.114738 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-56890bc5-c584-4b7a-b4c3-16755cf85685 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:23.119613 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-56890bc5-c584-4b7a-b4c3-16755cf85685 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:23.120277 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-56890bc5-c584-4b7a-b4c3-16755cf85685 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:23.121049 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-56890bc5-c584-4b7a-b4c3-16755cf85685 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:23.121483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-56890bc5-c584-4b7a-b4c3-16755cf85685 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:23.185574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-56890bc5-c584-4b7a-b4c3-16755cf85685 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:23.193381 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-56890bc5-c584-4b7a-b4c3-16755cf85685 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:23.194894 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-56890bc5-c584-4b7a-b4c3-16755cf85685 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:23.195997 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-56890bc5-c584-4b7a-b4c3-16755cf85685 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99" status: 200 len: 1339 microversion: 2.20 time: 0.086336 Jul 19 09:34:23.196545 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 568/1106] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:23 2021] GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 => generated 1339 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:34:23.942322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c2d1c8ee-d785-453f-bcc4-56d84a0aabf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:23.943058 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c2d1c8ee-d785-453f-bcc4-56d84a0aabf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:23.948836 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c2d1c8ee-d785-453f-bcc4-56d84a0aabf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:23.949289 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c2d1c8ee-d785-453f-bcc4-56d84a0aabf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:23.950055 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c2d1c8ee-d785-453f-bcc4-56d84a0aabf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:23.950496 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c2d1c8ee-d785-453f-bcc4-56d84a0aabf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:24.197989 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c2d1c8ee-d785-453f-bcc4-56d84a0aabf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:24.206369 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c2d1c8ee-d785-453f-bcc4-56d84a0aabf8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.267635 Jul 19 09:34:24.215799 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 539/1107] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:23 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:24.216006 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ecf1e078-7fe2-4e77-9de3-8ae42aaf95a2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:24.216006 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ecf1e078-7fe2-4e77-9de3-8ae42aaf95a2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:24.223605 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ecf1e078-7fe2-4e77-9de3-8ae42aaf95a2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:24.224182 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ecf1e078-7fe2-4e77-9de3-8ae42aaf95a2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:24.225483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ecf1e078-7fe2-4e77-9de3-8ae42aaf95a2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:24.226018 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ecf1e078-7fe2-4e77-9de3-8ae42aaf95a2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:24.373200 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ecf1e078-7fe2-4e77-9de3-8ae42aaf95a2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:24.383756 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ecf1e078-7fe2-4e77-9de3-8ae42aaf95a2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:24.385674 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ecf1e078-7fe2-4e77-9de3-8ae42aaf95a2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:24.386789 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ecf1e078-7fe2-4e77-9de3-8ae42aaf95a2 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99" status: 200 len: 1406 microversion: 2.20 time: 0.176904 Jul 19 09:34:24.387389 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 569/1108] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:24 2021] GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:24.402387 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-7acf4824-b0cf-4928-967a-2eb09a1a94c5 req-c1600d49-2b27-40e2-9f86-7e4a22ef2849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc900d8-8c3c-429b-953a-e2bcb0ef6d99", "tag": "06bb4f5b-08f4-4c1e-870c-960b0cc83027"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:24.403984 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:34:24.403984 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:34:24.411826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-7acf4824-b0cf-4928-967a-2eb09a1a94c5 req-c1600d49-2b27-40e2-9f86-7e4a22ef2849 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:24.412619 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-7acf4824-b0cf-4928-967a-2eb09a1a94c5 req-c1600d49-2b27-40e2-9f86-7e4a22ef2849 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:24.425048 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-7acf4824-b0cf-4928-967a-2eb09a1a94c5 req-c1600d49-2b27-40e2-9f86-7e4a22ef2849 service nova] Creating event network-changed:06bb4f5b-08f4-4c1e-870c-960b0cc83027 for instance 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 on hv-cinder-79338 Jul 19 09:34:24.430066 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-7acf4824-b0cf-4928-967a-2eb09a1a94c5 req-c1600d49-2b27-40e2-9f86-7e4a22ef2849 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031661 Jul 19 09:34:24.431224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 540/1109] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:34:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:34:25.223766 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b7a1aace-4dfd-45b0-b86d-57f739aaff72 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:25.224474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b7a1aace-4dfd-45b0-b86d-57f739aaff72 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:25.230267 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7a1aace-4dfd-45b0-b86d-57f739aaff72 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:25.230809 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7a1aace-4dfd-45b0-b86d-57f739aaff72 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:25.231675 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7a1aace-4dfd-45b0-b86d-57f739aaff72 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:25.232114 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7a1aace-4dfd-45b0-b86d-57f739aaff72 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:25.364103 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b7a1aace-4dfd-45b0-b86d-57f739aaff72 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:25.371332 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b7a1aace-4dfd-45b0-b86d-57f739aaff72 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151243 Jul 19 09:34:25.371886 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 570/1110] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:25 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:25.404893 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-303a0c3d-91a7-4871-9001-ec01d365d30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:25.406237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-303a0c3d-91a7-4871-9001-ec01d365d30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:25.412108 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-303a0c3d-91a7-4871-9001-ec01d365d30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:25.412560 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-303a0c3d-91a7-4871-9001-ec01d365d30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:25.413701 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-303a0c3d-91a7-4871-9001-ec01d365d30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:25.414018 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-303a0c3d-91a7-4871-9001-ec01d365d30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:25.549745 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-303a0c3d-91a7-4871-9001-ec01d365d30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:25.557661 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-303a0c3d-91a7-4871-9001-ec01d365d30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:25.558970 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-303a0c3d-91a7-4871-9001-ec01d365d30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:25.560156 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-303a0c3d-91a7-4871-9001-ec01d365d30f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99" status: 200 len: 1406 microversion: 2.20 time: 0.159304 Jul 19 09:34:25.560712 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 541/1111] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:25 2021] GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:26.387970 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8b2f134f-1a6a-48a6-b4c3-6f0d140f494f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:26.388673 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8b2f134f-1a6a-48a6-b4c3-6f0d140f494f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:26.394642 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8b2f134f-1a6a-48a6-b4c3-6f0d140f494f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:26.395126 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8b2f134f-1a6a-48a6-b4c3-6f0d140f494f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:26.395897 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8b2f134f-1a6a-48a6-b4c3-6f0d140f494f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:26.396329 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8b2f134f-1a6a-48a6-b4c3-6f0d140f494f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:26.530291 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8b2f134f-1a6a-48a6-b4c3-6f0d140f494f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:26.537515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8b2f134f-1a6a-48a6-b4c3-6f0d140f494f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.153290 Jul 19 09:34:26.538076 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 571/1112] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:26 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:26.577655 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d7d7aab9-568b-46f6-bce5-1404e7654111 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:26.578260 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d7d7aab9-568b-46f6-bce5-1404e7654111 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:26.585899 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d7d7aab9-568b-46f6-bce5-1404e7654111 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:26.586348 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d7d7aab9-568b-46f6-bce5-1404e7654111 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:26.587134 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d7d7aab9-568b-46f6-bce5-1404e7654111 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:26.587567 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d7d7aab9-568b-46f6-bce5-1404e7654111 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:26.720989 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d7d7aab9-568b-46f6-bce5-1404e7654111 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:26.728614 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d7d7aab9-568b-46f6-bce5-1404e7654111 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:26.730118 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d7d7aab9-568b-46f6-bce5-1404e7654111 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:26.731224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d7d7aab9-568b-46f6-bce5-1404e7654111 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99" status: 200 len: 1406 microversion: 2.20 time: 0.157297 Jul 19 09:34:26.731776 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 542/1113] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:26 2021] GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:27.554827 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-00c633c3-510b-4ebc-a7c0-2262bb412c4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:27.555454 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-00c633c3-510b-4ebc-a7c0-2262bb412c4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:27.561160 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-00c633c3-510b-4ebc-a7c0-2262bb412c4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:27.561627 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-00c633c3-510b-4ebc-a7c0-2262bb412c4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:27.562376 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-00c633c3-510b-4ebc-a7c0-2262bb412c4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:27.562803 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-00c633c3-510b-4ebc-a7c0-2262bb412c4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:27.696237 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-00c633c3-510b-4ebc-a7c0-2262bb412c4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:27.703735 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-00c633c3-510b-4ebc-a7c0-2262bb412c4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152481 Jul 19 09:34:27.704411 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 572/1114] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:27 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:27.748665 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-93afa4d1-5945-4164-829e-c0dae6c6e5c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:27.749278 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-93afa4d1-5945-4164-829e-c0dae6c6e5c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:27.755550 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93afa4d1-5945-4164-829e-c0dae6c6e5c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:27.755948 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93afa4d1-5945-4164-829e-c0dae6c6e5c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:27.756715 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93afa4d1-5945-4164-829e-c0dae6c6e5c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:27.757156 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93afa4d1-5945-4164-829e-c0dae6c6e5c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:27.885456 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-93afa4d1-5945-4164-829e-c0dae6c6e5c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:27.893595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-93afa4d1-5945-4164-829e-c0dae6c6e5c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:27.895126 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-93afa4d1-5945-4164-829e-c0dae6c6e5c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:27.896208 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-93afa4d1-5945-4164-829e-c0dae6c6e5c5 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99" status: 200 len: 1406 microversion: 2.20 time: 0.151263 Jul 19 09:34:27.896778 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 543/1115] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:27 2021] GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:28.442338 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-0e88aa6f-6627-4703-8215-cb1d0006a1cf req-1656ef4b-36da-404b-b387-afe137bc8a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc900d8-8c3c-429b-953a-e2bcb0ef6d99", "name": "network-vif-plugged", "status": "completed", "tag": "06bb4f5b-08f4-4c1e-870c-960b0cc83027"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:28.443992 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:34:28.443992 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:34:28.450646 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-0e88aa6f-6627-4703-8215-cb1d0006a1cf req-1656ef4b-36da-404b-b387-afe137bc8a66 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:28.452020 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-0e88aa6f-6627-4703-8215-cb1d0006a1cf req-1656ef4b-36da-404b-b387-afe137bc8a66 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:28.464157 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-0e88aa6f-6627-4703-8215-cb1d0006a1cf req-1656ef4b-36da-404b-b387-afe137bc8a66 service nova] Creating event network-vif-plugged:06bb4f5b-08f4-4c1e-870c-960b0cc83027 for instance 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 on hv-cinder-79338 Jul 19 09:34:28.470648 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-0e88aa6f-6627-4703-8215-cb1d0006a1cf req-1656ef4b-36da-404b-b387-afe137bc8a66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083003 Jul 19 09:34:28.471395 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 573/1116] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:34:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:34:28.720844 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e5c34024-5755-4b3c-95e6-99758d7ccc14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:28.721469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e5c34024-5755-4b3c-95e6-99758d7ccc14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:28.727169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e5c34024-5755-4b3c-95e6-99758d7ccc14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:28.727620 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e5c34024-5755-4b3c-95e6-99758d7ccc14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:28.728384 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e5c34024-5755-4b3c-95e6-99758d7ccc14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:28.728817 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e5c34024-5755-4b3c-95e6-99758d7ccc14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:28.859873 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e5c34024-5755-4b3c-95e6-99758d7ccc14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:28.867007 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e5c34024-5755-4b3c-95e6-99758d7ccc14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150408 Jul 19 09:34:28.867604 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 544/1117] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:28 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:28.915144 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d40cb828-6a66-4d8b-8e06-811664d824c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:28.915832 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d40cb828-6a66-4d8b-8e06-811664d824c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:28.922293 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d40cb828-6a66-4d8b-8e06-811664d824c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:28.922742 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d40cb828-6a66-4d8b-8e06-811664d824c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:28.923524 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d40cb828-6a66-4d8b-8e06-811664d824c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:28.923953 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d40cb828-6a66-4d8b-8e06-811664d824c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:29.054970 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d40cb828-6a66-4d8b-8e06-811664d824c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:29.063144 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d40cb828-6a66-4d8b-8e06-811664d824c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:29.064657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d40cb828-6a66-4d8b-8e06-811664d824c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:29.065736 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d40cb828-6a66-4d8b-8e06-811664d824c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99" status: 200 len: 1406 microversion: 2.20 time: 0.154831 Jul 19 09:34:29.066288 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 574/1118] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:28 2021] GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:29.883997 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b6725d66-afc4-4aed-b1e5-8c363b4c9630 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:29.884599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b6725d66-afc4-4aed-b1e5-8c363b4c9630 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:29.890233 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b6725d66-afc4-4aed-b1e5-8c363b4c9630 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:29.890670 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b6725d66-afc4-4aed-b1e5-8c363b4c9630 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:29.891453 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b6725d66-afc4-4aed-b1e5-8c363b4c9630 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:29.891882 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b6725d66-afc4-4aed-b1e5-8c363b4c9630 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:30.026873 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b6725d66-afc4-4aed-b1e5-8c363b4c9630 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:30.034603 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b6725d66-afc4-4aed-b1e5-8c363b4c9630 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.154184 Jul 19 09:34:30.035180 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 545/1119] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:29 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:30.083530 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-da02dec7-04e6-489d-9f60-d88870354b20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:30.084141 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-da02dec7-04e6-489d-9f60-d88870354b20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:30.089851 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da02dec7-04e6-489d-9f60-d88870354b20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:30.090301 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da02dec7-04e6-489d-9f60-d88870354b20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:30.091084 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da02dec7-04e6-489d-9f60-d88870354b20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:30.091520 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da02dec7-04e6-489d-9f60-d88870354b20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:30.225649 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-da02dec7-04e6-489d-9f60-d88870354b20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:30.233249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-da02dec7-04e6-489d-9f60-d88870354b20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:30.234749 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-da02dec7-04e6-489d-9f60-d88870354b20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:30.235896 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-da02dec7-04e6-489d-9f60-d88870354b20 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99" status: 200 len: 1599 microversion: 2.20 time: 0.156006 Jul 19 09:34:30.236451 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 575/1120] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:34:30 2021] GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:30.252868 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-98cbb49f-0e44-4bd2-b3cc-42b58a16f26d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:30.253387 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-98cbb49f-0e44-4bd2-b3cc-42b58a16f26d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:30.258972 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98cbb49f-0e44-4bd2-b3cc-42b58a16f26d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:30.259449 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98cbb49f-0e44-4bd2-b3cc-42b58a16f26d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:30.260196 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98cbb49f-0e44-4bd2-b3cc-42b58a16f26d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:30.260625 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98cbb49f-0e44-4bd2-b3cc-42b58a16f26d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:30.350390 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-98cbb49f-0e44-4bd2-b3cc-42b58a16f26d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101337 Jul 19 09:34:30.350986 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 546/1121] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Jul 19 09:34:30 2021] GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:34:31.051101 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-047fa5bd-d7ec-4d26-8bae-e24387c22916 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:31.051738 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-047fa5bd-d7ec-4d26-8bae-e24387c22916 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:31.057748 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-047fa5bd-d7ec-4d26-8bae-e24387c22916 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:31.058190 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-047fa5bd-d7ec-4d26-8bae-e24387c22916 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:31.058956 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-047fa5bd-d7ec-4d26-8bae-e24387c22916 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:31.059417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-047fa5bd-d7ec-4d26-8bae-e24387c22916 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:31.215483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-047fa5bd-d7ec-4d26-8bae-e24387c22916 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:31.222679 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-047fa5bd-d7ec-4d26-8bae-e24387c22916 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.175283 Jul 19 09:34:31.223336 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 576/1122] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:31 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:31.593875 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0f014f76-a9fa-4156-a167-47dbd6c27648 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:31.594842 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0f014f76-a9fa-4156-a167-47dbd6c27648 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:31.601196 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0f014f76-a9fa-4156-a167-47dbd6c27648 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:31.601528 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-8b7f271b-0e05-4cdb-b90b-4d008f909ef5 req-760585dc-c090-4a45-96f0-f900ed8593e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc900d8-8c3c-429b-953a-e2bcb0ef6d99", "tag": "06bb4f5b-08f4-4c1e-870c-960b0cc83027"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:31.601776 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0f014f76-a9fa-4156-a167-47dbd6c27648 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:31.602665 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0f014f76-a9fa-4156-a167-47dbd6c27648 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:31.603078 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:34:31.603078 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:34:31.603249 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0f014f76-a9fa-4156-a167-47dbd6c27648 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:31.610244 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-8b7f271b-0e05-4cdb-b90b-4d008f909ef5 req-760585dc-c090-4a45-96f0-f900ed8593e9 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:31.610678 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-8b7f271b-0e05-4cdb-b90b-4d008f909ef5 req-760585dc-c090-4a45-96f0-f900ed8593e9 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:31.621292 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-8b7f271b-0e05-4cdb-b90b-4d008f909ef5 req-760585dc-c090-4a45-96f0-f900ed8593e9 service nova] Creating event network-changed:06bb4f5b-08f4-4c1e-870c-960b0cc83027 for instance 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 on hv-cinder-79338 Jul 19 09:34:31.626745 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-8b7f271b-0e05-4cdb-b90b-4d008f909ef5 req-760585dc-c090-4a45-96f0-f900ed8593e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029088 Jul 19 09:34:31.627664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 577/1123] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:34:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:34:31.667200 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0f014f76-a9fa-4156-a167-47dbd6c27648 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 14 microversion: 2.20 time: 0.076700 Jul 19 09:34:31.670453 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 547/1124] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:31 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:32.240727 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-eb84b9ef-fccc-4722-a8c8-1e9b23c8d832 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:32.241492 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-eb84b9ef-fccc-4722-a8c8-1e9b23c8d832 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:32.247405 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eb84b9ef-fccc-4722-a8c8-1e9b23c8d832 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:32.247862 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eb84b9ef-fccc-4722-a8c8-1e9b23c8d832 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:32.248693 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eb84b9ef-fccc-4722-a8c8-1e9b23c8d832 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:32.249135 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eb84b9ef-fccc-4722-a8c8-1e9b23c8d832 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:32.385463 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-eb84b9ef-fccc-4722-a8c8-1e9b23c8d832 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:32.393454 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-eb84b9ef-fccc-4722-a8c8-1e9b23c8d832 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.156831 Jul 19 09:34:32.394033 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 578/1125] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:32 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:32.678341 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5d29d9a0-6198-4340-8a6f-fe5aa02504ce tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:32.679380 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5d29d9a0-6198-4340-8a6f-fe5aa02504ce tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:32.686014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5d29d9a0-6198-4340-8a6f-fe5aa02504ce tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:32.686467 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5d29d9a0-6198-4340-8a6f-fe5aa02504ce tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:32.687274 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5d29d9a0-6198-4340-8a6f-fe5aa02504ce tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:32.687740 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5d29d9a0-6198-4340-8a6f-fe5aa02504ce tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:32.746985 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5d29d9a0-6198-4340-8a6f-fe5aa02504ce tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 14 microversion: 2.20 time: 0.072533 Jul 19 09:34:32.747568 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 548/1126] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:32 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:33.409819 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2f4225b6-5c11-4f79-9f37-93b42b9b4d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:33.410467 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2f4225b6-5c11-4f79-9f37-93b42b9b4d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:33.416563 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f4225b6-5c11-4f79-9f37-93b42b9b4d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:33.417005 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f4225b6-5c11-4f79-9f37-93b42b9b4d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:33.417762 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f4225b6-5c11-4f79-9f37-93b42b9b4d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:33.418190 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f4225b6-5c11-4f79-9f37-93b42b9b4d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:33.552867 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2f4225b6-5c11-4f79-9f37-93b42b9b4d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:33.560036 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2f4225b6-5c11-4f79-9f37-93b42b9b4d14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.153845 Jul 19 09:34:33.560656 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 579/1127] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:33 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:33.757958 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-be02a06a-e9ad-47a5-a3bf-cf6ef6593c30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:33.758981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-be02a06a-e9ad-47a5-a3bf-cf6ef6593c30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:33.765811 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be02a06a-e9ad-47a5-a3bf-cf6ef6593c30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:33.766253 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be02a06a-e9ad-47a5-a3bf-cf6ef6593c30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:33.767009 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be02a06a-e9ad-47a5-a3bf-cf6ef6593c30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:33.767463 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be02a06a-e9ad-47a5-a3bf-cf6ef6593c30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:33.824957 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-be02a06a-e9ad-47a5-a3bf-cf6ef6593c30 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 14 microversion: 2.20 time: 0.070924 Jul 19 09:34:33.825514 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 549/1128] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:33 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:34.577846 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8df0b6c4-e1a9-4967-a84f-cb1c53adc50d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:34.578453 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8df0b6c4-e1a9-4967-a84f-cb1c53adc50d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:34.584318 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8df0b6c4-e1a9-4967-a84f-cb1c53adc50d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:34.584766 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8df0b6c4-e1a9-4967-a84f-cb1c53adc50d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:34.585524 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8df0b6c4-e1a9-4967-a84f-cb1c53adc50d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:34.585957 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8df0b6c4-e1a9-4967-a84f-cb1c53adc50d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:34.714271 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8df0b6c4-e1a9-4967-a84f-cb1c53adc50d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:34.722029 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8df0b6c4-e1a9-4967-a84f-cb1c53adc50d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148350 Jul 19 09:34:34.722589 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 580/1129] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:34 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:34.836485 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4d667893-f00a-47d8-9c51-a1bc9f034864 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:34.837472 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4d667893-f00a-47d8-9c51-a1bc9f034864 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:34.844328 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4d667893-f00a-47d8-9c51-a1bc9f034864 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:34.844776 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4d667893-f00a-47d8-9c51-a1bc9f034864 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:34.845537 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4d667893-f00a-47d8-9c51-a1bc9f034864 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:34.845972 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4d667893-f00a-47d8-9c51-a1bc9f034864 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:34.902732 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4d667893-f00a-47d8-9c51-a1bc9f034864 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 14 microversion: 2.20 time: 0.070143 Jul 19 09:34:34.903688 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 550/1130] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:34 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:35.738977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-833b3501-76f4-41f9-b6e5-427c40dfc011 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:35.739609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-833b3501-76f4-41f9-b6e5-427c40dfc011 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:35.745332 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-833b3501-76f4-41f9-b6e5-427c40dfc011 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:35.745775 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-833b3501-76f4-41f9-b6e5-427c40dfc011 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:35.746521 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-833b3501-76f4-41f9-b6e5-427c40dfc011 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:35.746947 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-833b3501-76f4-41f9-b6e5-427c40dfc011 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:35.878176 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-833b3501-76f4-41f9-b6e5-427c40dfc011 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:35.885462 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-833b3501-76f4-41f9-b6e5-427c40dfc011 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150119 Jul 19 09:34:35.886021 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 581/1131] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:35 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:35.914317 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-067a4d0f-91b9-4b42-86d1-16c9d2119dba tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:35.915357 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-067a4d0f-91b9-4b42-86d1-16c9d2119dba tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:35.922382 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-067a4d0f-91b9-4b42-86d1-16c9d2119dba tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:35.922834 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-067a4d0f-91b9-4b42-86d1-16c9d2119dba tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:35.923642 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-067a4d0f-91b9-4b42-86d1-16c9d2119dba tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:35.924082 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-067a4d0f-91b9-4b42-86d1-16c9d2119dba tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:35.981696 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-067a4d0f-91b9-4b42-86d1-16c9d2119dba tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 14 microversion: 2.20 time: 0.071593 Jul 19 09:34:35.982500 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 551/1132] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:35 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:34:36.902041 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0c39d134-e19d-4242-9794-2a485c52adb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:36.902644 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0c39d134-e19d-4242-9794-2a485c52adb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:36.908495 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0c39d134-e19d-4242-9794-2a485c52adb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:36.908941 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0c39d134-e19d-4242-9794-2a485c52adb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:36.909696 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0c39d134-e19d-4242-9794-2a485c52adb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:36.910126 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0c39d134-e19d-4242-9794-2a485c52adb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:36.993784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7b45f33a-b4ab-45d0-8a74-a2502949321b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:36.994787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7b45f33a-b4ab-45d0-8a74-a2502949321b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:37.001844 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b45f33a-b4ab-45d0-8a74-a2502949321b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:37.002501 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b45f33a-b4ab-45d0-8a74-a2502949321b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:37.003308 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b45f33a-b4ab-45d0-8a74-a2502949321b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:37.003746 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b45f33a-b4ab-45d0-8a74-a2502949321b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:37.050060 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0c39d134-e19d-4242-9794-2a485c52adb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:37.057494 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0c39d134-e19d-4242-9794-2a485c52adb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.159142 Jul 19 09:34:37.058051 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 582/1133] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:36 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:37.065170 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7b45f33a-b4ab-45d0-8a74-a2502949321b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 14 microversion: 2.20 time: 0.075261 Jul 19 09:34:37.065823 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 552/1134] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:36 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:34:38.074783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-26f3960e-3227-4d73-926b-f8cddcd6b8c5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:38.075541 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-26f3960e-3227-4d73-926b-f8cddcd6b8c5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:38.076514 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-24f019db-3b91-4f9c-8dcf-9a888098a5ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:38.077520 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-24f019db-3b91-4f9c-8dcf-9a888098a5ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:38.082059 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26f3960e-3227-4d73-926b-f8cddcd6b8c5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:38.082506 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26f3960e-3227-4d73-926b-f8cddcd6b8c5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:38.083330 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26f3960e-3227-4d73-926b-f8cddcd6b8c5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:38.083765 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-26f3960e-3227-4d73-926b-f8cddcd6b8c5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:38.085621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-24f019db-3b91-4f9c-8dcf-9a888098a5ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:38.087321 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-24f019db-3b91-4f9c-8dcf-9a888098a5ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:38.087321 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-24f019db-3b91-4f9c-8dcf-9a888098a5ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:38.087567 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-24f019db-3b91-4f9c-8dcf-9a888098a5ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:38.149204 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-24f019db-3b91-4f9c-8dcf-9a888098a5ed tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 14 microversion: 2.20 time: 0.076529 Jul 19 09:34:38.149861 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 553/1135] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:38 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:38.226910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-26f3960e-3227-4d73-926b-f8cddcd6b8c5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:38.234877 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-26f3960e-3227-4d73-926b-f8cddcd6b8c5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.163153 Jul 19 09:34:38.235756 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 583/1136] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:38 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:39.161169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-72d15e4d-e8e3-4e4e-94d6-3959acb3b2eb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:39.162155 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-72d15e4d-e8e3-4e4e-94d6-3959acb3b2eb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:39.168850 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72d15e4d-e8e3-4e4e-94d6-3959acb3b2eb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:39.169295 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72d15e4d-e8e3-4e4e-94d6-3959acb3b2eb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:39.170061 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72d15e4d-e8e3-4e4e-94d6-3959acb3b2eb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:39.170493 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72d15e4d-e8e3-4e4e-94d6-3959acb3b2eb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:39.228956 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-72d15e4d-e8e3-4e4e-94d6-3959acb3b2eb tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 14 microversion: 2.20 time: 0.071809 Jul 19 09:34:39.229565 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 554/1137] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:39 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:39.251866 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4e10b92e-9e99-4ccc-8676-0376b8833bf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:39.252468 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4e10b92e-9e99-4ccc-8676-0376b8833bf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:39.258194 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4e10b92e-9e99-4ccc-8676-0376b8833bf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:39.258641 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4e10b92e-9e99-4ccc-8676-0376b8833bf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:39.259426 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4e10b92e-9e99-4ccc-8676-0376b8833bf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:39.259857 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4e10b92e-9e99-4ccc-8676-0376b8833bf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:39.393366 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4e10b92e-9e99-4ccc-8676-0376b8833bf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:39.400422 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4e10b92e-9e99-4ccc-8676-0376b8833bf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152366 Jul 19 09:34:39.400981 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 584/1138] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:39 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:40.240775 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7daab9ff-a505-4ab7-90f6-03122e84f41d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:40.241807 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7daab9ff-a505-4ab7-90f6-03122e84f41d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:40.248187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7daab9ff-a505-4ab7-90f6-03122e84f41d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:40.248639 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7daab9ff-a505-4ab7-90f6-03122e84f41d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:40.249405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7daab9ff-a505-4ab7-90f6-03122e84f41d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:40.249866 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7daab9ff-a505-4ab7-90f6-03122e84f41d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:40.311617 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7daab9ff-a505-4ab7-90f6-03122e84f41d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 14 microversion: 2.20 time: 0.074728 Jul 19 09:34:40.312218 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 555/1139] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:40 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:40.417252 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e47e18b4-6c6a-4099-a033-19e0093d00be tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:40.417802 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e47e18b4-6c6a-4099-a033-19e0093d00be tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:40.424067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e47e18b4-6c6a-4099-a033-19e0093d00be tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:40.424516 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e47e18b4-6c6a-4099-a033-19e0093d00be tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:40.425283 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e47e18b4-6c6a-4099-a033-19e0093d00be tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:40.425719 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e47e18b4-6c6a-4099-a033-19e0093d00be tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:40.553574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e47e18b4-6c6a-4099-a033-19e0093d00be tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:40.560739 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e47e18b4-6c6a-4099-a033-19e0093d00be tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147520 Jul 19 09:34:40.561309 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 585/1140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:40 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:41.323152 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8b9d8599-abfe-417e-8021-7f37c4d6096b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:41.324151 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8b9d8599-abfe-417e-8021-7f37c4d6096b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:41.331110 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8b9d8599-abfe-417e-8021-7f37c4d6096b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:41.331562 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8b9d8599-abfe-417e-8021-7f37c4d6096b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:41.332320 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8b9d8599-abfe-417e-8021-7f37c4d6096b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:41.332756 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8b9d8599-abfe-417e-8021-7f37c4d6096b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:41.393450 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8b9d8599-abfe-417e-8021-7f37c4d6096b tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 6451 microversion: 2.20 time: 0.074207 Jul 19 09:34:41.396704 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 556/1141] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:41 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 6451 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:34:41.578515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-49da895f-a90a-469b-93df-8177a3061429 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:41.579081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-49da895f-a90a-469b-93df-8177a3061429 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:41.584757 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49da895f-a90a-469b-93df-8177a3061429 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:41.585224 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49da895f-a90a-469b-93df-8177a3061429 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:41.585997 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49da895f-a90a-469b-93df-8177a3061429 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:41.586433 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49da895f-a90a-469b-93df-8177a3061429 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:41.721295 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-49da895f-a90a-469b-93df-8177a3061429 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:41.728579 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-49da895f-a90a-469b-93df-8177a3061429 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.154294 Jul 19 09:34:41.729142 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 586/1142] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:41 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:42.403940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-391455e2-0473-4426-ba3e-b97f4104b215 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:42.404939 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-391455e2-0473-4426-ba3e-b97f4104b215 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:42.411396 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-391455e2-0473-4426-ba3e-b97f4104b215 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:42.411842 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-391455e2-0473-4426-ba3e-b97f4104b215 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:42.412607 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-391455e2-0473-4426-ba3e-b97f4104b215 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:42.413035 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-391455e2-0473-4426-ba3e-b97f4104b215 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:42.485553 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-391455e2-0473-4426-ba3e-b97f4104b215 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 15025 microversion: 2.20 time: 0.085500 Jul 19 09:34:42.486341 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 557/1143] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:42 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 15025 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:34:42.745276 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3d407360-a79f-426b-a1a0-1ddcf0f79eaa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:42.745882 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3d407360-a79f-426b-a1a0-1ddcf0f79eaa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:42.752164 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3d407360-a79f-426b-a1a0-1ddcf0f79eaa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:42.752614 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3d407360-a79f-426b-a1a0-1ddcf0f79eaa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:42.753375 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3d407360-a79f-426b-a1a0-1ddcf0f79eaa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:42.753808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3d407360-a79f-426b-a1a0-1ddcf0f79eaa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:42.881403 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3d407360-a79f-426b-a1a0-1ddcf0f79eaa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:42.888609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3d407360-a79f-426b-a1a0-1ddcf0f79eaa tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.146987 Jul 19 09:34:42.889173 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 587/1144] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:42 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:43.497364 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e3decf1f-cc97-4fd3-bc9b-a7e6332c3f25 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:43.498373 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e3decf1f-cc97-4fd3-bc9b-a7e6332c3f25 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:43.504456 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e3decf1f-cc97-4fd3-bc9b-a7e6332c3f25 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:43.504899 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e3decf1f-cc97-4fd3-bc9b-a7e6332c3f25 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:43.505656 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e3decf1f-cc97-4fd3-bc9b-a7e6332c3f25 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:43.506082 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e3decf1f-cc97-4fd3-bc9b-a7e6332c3f25 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:43.569479 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e3decf1f-cc97-4fd3-bc9b-a7e6332c3f25 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 18561 microversion: 2.20 time: 0.076136 Jul 19 09:34:43.570082 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 558/1145] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:43 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 18561 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:34:43.904932 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d72fdffc-1bad-466c-a4ab-7e4e93774fbe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:43.905540 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d72fdffc-1bad-466c-a4ab-7e4e93774fbe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:43.912047 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d72fdffc-1bad-466c-a4ab-7e4e93774fbe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:43.912503 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d72fdffc-1bad-466c-a4ab-7e4e93774fbe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:43.913538 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d72fdffc-1bad-466c-a4ab-7e4e93774fbe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:43.913975 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d72fdffc-1bad-466c-a4ab-7e4e93774fbe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:44.042816 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d72fdffc-1bad-466c-a4ab-7e4e93774fbe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:44.050567 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d72fdffc-1bad-466c-a4ab-7e4e93774fbe tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149294 Jul 19 09:34:44.051149 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 588/1146] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:43 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:44.581555 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f60b49eb-08bd-4f11-92d8-cf6f6c769c09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:44.582546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f60b49eb-08bd-4f11-92d8-cf6f6c769c09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:44.588927 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f60b49eb-08bd-4f11-92d8-cf6f6c769c09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:44.589398 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f60b49eb-08bd-4f11-92d8-cf6f6c769c09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:44.590156 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f60b49eb-08bd-4f11-92d8-cf6f6c769c09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:44.590584 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f60b49eb-08bd-4f11-92d8-cf6f6c769c09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:44.649076 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f60b49eb-08bd-4f11-92d8-cf6f6c769c09 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 19342 microversion: 2.20 time: 0.071949 Jul 19 09:34:44.649716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 559/1147] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:44 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 19342 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:34:45.067647 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a3b8bd34-3c8d-42cf-bf75-60e37968c6c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:45.068160 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a3b8bd34-3c8d-42cf-bf75-60e37968c6c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:45.073891 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a3b8bd34-3c8d-42cf-bf75-60e37968c6c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:45.074342 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a3b8bd34-3c8d-42cf-bf75-60e37968c6c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:45.075131 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a3b8bd34-3c8d-42cf-bf75-60e37968c6c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:45.075566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a3b8bd34-3c8d-42cf-bf75-60e37968c6c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:45.207418 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a3b8bd34-3c8d-42cf-bf75-60e37968c6c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:45.214624 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a3b8bd34-3c8d-42cf-bf75-60e37968c6c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150704 Jul 19 09:34:45.215206 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 589/1148] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:45 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:45.661019 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1b540c87-16ad-49a8-9d6a-4a4e6cb84bbd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:45.662017 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1b540c87-16ad-49a8-9d6a-4a4e6cb84bbd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:45.668643 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1b540c87-16ad-49a8-9d6a-4a4e6cb84bbd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:45.669094 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1b540c87-16ad-49a8-9d6a-4a4e6cb84bbd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:45.669849 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1b540c87-16ad-49a8-9d6a-4a4e6cb84bbd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:45.670280 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1b540c87-16ad-49a8-9d6a-4a4e6cb84bbd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:45.731463 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1b540c87-16ad-49a8-9d6a-4a4e6cb84bbd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 22217 microversion: 2.20 time: 0.074374 Jul 19 09:34:45.732045 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 560/1149] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:45 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 22217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:34:46.231294 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e96aea5f-63e1-4da1-b1bc-0fbd54ba09e8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:46.231895 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e96aea5f-63e1-4da1-b1bc-0fbd54ba09e8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:46.237649 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e96aea5f-63e1-4da1-b1bc-0fbd54ba09e8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:46.238091 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e96aea5f-63e1-4da1-b1bc-0fbd54ba09e8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:46.238838 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e96aea5f-63e1-4da1-b1bc-0fbd54ba09e8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:46.239289 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e96aea5f-63e1-4da1-b1bc-0fbd54ba09e8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:46.367588 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e96aea5f-63e1-4da1-b1bc-0fbd54ba09e8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:46.374634 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e96aea5f-63e1-4da1-b1bc-0fbd54ba09e8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147005 Jul 19 09:34:46.375226 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 590/1150] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:46 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:46.742980 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-07cb93e0-692d-480c-91af-063bd124a46d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:46.744010 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-07cb93e0-692d-480c-91af-063bd124a46d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:46.755710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-07cb93e0-692d-480c-91af-063bd124a46d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:46.756168 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-07cb93e0-692d-480c-91af-063bd124a46d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:46.757639 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-07cb93e0-692d-480c-91af-063bd124a46d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:46.758087 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-07cb93e0-692d-480c-91af-063bd124a46d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:46.821015 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-07cb93e0-692d-480c-91af-063bd124a46d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 23804 microversion: 2.20 time: 0.081840 Jul 19 09:34:46.821557 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 561/1151] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:46 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 23804 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:34:47.391340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-fccc317c-ddac-4973-aa2e-757ed19acf4d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:47.391985 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-fccc317c-ddac-4973-aa2e-757ed19acf4d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:47.397677 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fccc317c-ddac-4973-aa2e-757ed19acf4d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:47.398127 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fccc317c-ddac-4973-aa2e-757ed19acf4d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:47.398886 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fccc317c-ddac-4973-aa2e-757ed19acf4d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:47.399345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fccc317c-ddac-4973-aa2e-757ed19acf4d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:47.530999 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-fccc317c-ddac-4973-aa2e-757ed19acf4d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:47.538370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-fccc317c-ddac-4973-aa2e-757ed19acf4d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150477 Jul 19 09:34:47.538931 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 591/1152] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:47 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:34:47.832039 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-dc984dac-6d9d-4cd7-9d94-ff7bf4f0c25f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:47.832971 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-dc984dac-6d9d-4cd7-9d94-ff7bf4f0c25f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:47.839588 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dc984dac-6d9d-4cd7-9d94-ff7bf4f0c25f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:47.840033 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dc984dac-6d9d-4cd7-9d94-ff7bf4f0c25f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:47.840789 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dc984dac-6d9d-4cd7-9d94-ff7bf4f0c25f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:47.841218 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dc984dac-6d9d-4cd7-9d94-ff7bf4f0c25f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:47.901360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-dc984dac-6d9d-4cd7-9d94-ff7bf4f0c25f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 25579 microversion: 2.20 time: 0.073257 Jul 19 09:34:47.902023 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 562/1153] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:47 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 25579 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:34:48.555600 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1cc834f4-5152-4fc7-8bc6-f8b5ad090603 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:48.556137 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1cc834f4-5152-4fc7-8bc6-f8b5ad090603 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:48.562538 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1cc834f4-5152-4fc7-8bc6-f8b5ad090603 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:48.562985 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1cc834f4-5152-4fc7-8bc6-f8b5ad090603 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:48.563766 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1cc834f4-5152-4fc7-8bc6-f8b5ad090603 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:48.564198 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1cc834f4-5152-4fc7-8bc6-f8b5ad090603 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:48.694489 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1cc834f4-5152-4fc7-8bc6-f8b5ad090603 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:48.701860 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1cc834f4-5152-4fc7-8bc6-f8b5ad090603 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150005 Jul 19 09:34:48.702417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 592/1154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:48 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:48.913686 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b31bdfe2-8efc-4171-96ec-87ea2eeed0b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:48.914721 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b31bdfe2-8efc-4171-96ec-87ea2eeed0b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:48.921685 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b31bdfe2-8efc-4171-96ec-87ea2eeed0b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:48.922096 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b31bdfe2-8efc-4171-96ec-87ea2eeed0b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:48.922896 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b31bdfe2-8efc-4171-96ec-87ea2eeed0b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:48.923329 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b31bdfe2-8efc-4171-96ec-87ea2eeed0b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:48.983378 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b31bdfe2-8efc-4171-96ec-87ea2eeed0b0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 26954 microversion: 2.20 time: 0.073836 Jul 19 09:34:48.984841 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 563/1155] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:48 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 26954 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:34:49.718940 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-eede92ce-5ea1-42e2-a149-2bdb5120cd99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:49.719593 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-eede92ce-5ea1-42e2-a149-2bdb5120cd99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:49.725306 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eede92ce-5ea1-42e2-a149-2bdb5120cd99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:49.729369 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eede92ce-5ea1-42e2-a149-2bdb5120cd99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:49.729369 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eede92ce-5ea1-42e2-a149-2bdb5120cd99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:49.729369 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eede92ce-5ea1-42e2-a149-2bdb5120cd99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:49.856361 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-eede92ce-5ea1-42e2-a149-2bdb5120cd99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:49.864143 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-eede92ce-5ea1-42e2-a149-2bdb5120cd99 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148859 Jul 19 09:34:49.864718 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 593/1156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:49 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:49.996052 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5c4c79e7-de30-42e3-b013-cd63c015c4f0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:49.997041 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5c4c79e7-de30-42e3-b013-cd63c015c4f0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:50.004210 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c4c79e7-de30-42e3-b013-cd63c015c4f0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:50.004657 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c4c79e7-de30-42e3-b013-cd63c015c4f0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:50.005475 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c4c79e7-de30-42e3-b013-cd63c015c4f0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:50.005909 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5c4c79e7-de30-42e3-b013-cd63c015c4f0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:50.068573 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5c4c79e7-de30-42e3-b013-cd63c015c4f0 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 27756 microversion: 2.20 time: 0.076605 Jul 19 09:34:50.072635 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 564/1157] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:49 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 27756 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:34:50.880976 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f2fe326a-31fa-414d-af2a-6d838a6814fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:50.881587 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f2fe326a-31fa-414d-af2a-6d838a6814fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:50.887264 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2fe326a-31fa-414d-af2a-6d838a6814fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:50.887719 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2fe326a-31fa-414d-af2a-6d838a6814fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:50.888479 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2fe326a-31fa-414d-af2a-6d838a6814fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:50.888918 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2fe326a-31fa-414d-af2a-6d838a6814fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:51.023950 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f2fe326a-31fa-414d-af2a-6d838a6814fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:51.031729 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f2fe326a-31fa-414d-af2a-6d838a6814fb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.154470 Jul 19 09:34:51.032297 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 594/1158] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:50 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:51.080755 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-463752c4-8044-4a68-a2bc-07fbeca4b893 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:51.081780 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-463752c4-8044-4a68-a2bc-07fbeca4b893 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:51.088297 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-463752c4-8044-4a68-a2bc-07fbeca4b893 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:51.088752 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-463752c4-8044-4a68-a2bc-07fbeca4b893 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:51.089525 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-463752c4-8044-4a68-a2bc-07fbeca4b893 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:51.089963 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-463752c4-8044-4a68-a2bc-07fbeca4b893 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:51.157051 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-463752c4-8044-4a68-a2bc-07fbeca4b893 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 28236 microversion: 2.20 time: 0.080280 Jul 19 09:34:51.160972 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 565/1159] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:51 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 28236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:34:52.049752 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3acd6fff-e271-4c26-925c-9cde22b70e1b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:52.050326 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3acd6fff-e271-4c26-925c-9cde22b70e1b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:52.056092 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3acd6fff-e271-4c26-925c-9cde22b70e1b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:52.056535 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3acd6fff-e271-4c26-925c-9cde22b70e1b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:52.057291 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3acd6fff-e271-4c26-925c-9cde22b70e1b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:52.057718 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3acd6fff-e271-4c26-925c-9cde22b70e1b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:52.178545 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-97268d2a-319d-4d5b-9186-44c5156e48c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:52.178545 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-97268d2a-319d-4d5b-9186-44c5156e48c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:52.181154 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97268d2a-319d-4d5b-9186-44c5156e48c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:52.181615 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97268d2a-319d-4d5b-9186-44c5156e48c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:52.182398 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97268d2a-319d-4d5b-9186-44c5156e48c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:52.182842 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97268d2a-319d-4d5b-9186-44c5156e48c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:52.191223 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3acd6fff-e271-4c26-925c-9cde22b70e1b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:52.198573 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3acd6fff-e271-4c26-925c-9cde22b70e1b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.153069 Jul 19 09:34:52.199389 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 595/1160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:52 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:52.251050 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-97268d2a-319d-4d5b-9186-44c5156e48c8 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 28236 microversion: 2.20 time: 0.084001 Jul 19 09:34:52.251891 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 566/1161] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:52 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 28236 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:34:53.215535 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cc0c2c75-281b-4479-a6ac-f3d43264a64f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:53.216136 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-cc0c2c75-281b-4479-a6ac-f3d43264a64f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:53.222324 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc0c2c75-281b-4479-a6ac-f3d43264a64f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:53.222787 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc0c2c75-281b-4479-a6ac-f3d43264a64f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:53.223568 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc0c2c75-281b-4479-a6ac-f3d43264a64f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:53.223993 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc0c2c75-281b-4479-a6ac-f3d43264a64f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:53.262430 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-dfeafaa9-134c-446a-b91a-05409affc604 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:53.263633 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-dfeafaa9-134c-446a-b91a-05409affc604 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:53.270445 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dfeafaa9-134c-446a-b91a-05409affc604 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:53.270892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dfeafaa9-134c-446a-b91a-05409affc604 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:53.271779 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dfeafaa9-134c-446a-b91a-05409affc604 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:53.272222 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dfeafaa9-134c-446a-b91a-05409affc604 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:53.333322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-dfeafaa9-134c-446a-b91a-05409affc604 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 28527 microversion: 2.20 time: 0.074699 Jul 19 09:34:53.337194 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 567/1162] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:53 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 28527 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:34:53.359716 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cc0c2c75-281b-4479-a6ac-f3d43264a64f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:53.366923 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-cc0c2c75-281b-4479-a6ac-f3d43264a64f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.154988 Jul 19 09:34:53.367587 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 596/1163] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:53 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:54.345250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9504b604-c0b7-42eb-98ad-dd1d3039502a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:54.346238 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9504b604-c0b7-42eb-98ad-dd1d3039502a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:54.352611 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9504b604-c0b7-42eb-98ad-dd1d3039502a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:54.353052 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9504b604-c0b7-42eb-98ad-dd1d3039502a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:54.353810 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9504b604-c0b7-42eb-98ad-dd1d3039502a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:54.354236 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9504b604-c0b7-42eb-98ad-dd1d3039502a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:54.384932 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-40ae60d8-b163-48b7-95b8-247177ab2e4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:54.385646 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-40ae60d8-b163-48b7-95b8-247177ab2e4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:54.392022 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40ae60d8-b163-48b7-95b8-247177ab2e4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:54.392472 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40ae60d8-b163-48b7-95b8-247177ab2e4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:54.393226 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40ae60d8-b163-48b7-95b8-247177ab2e4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:54.393658 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40ae60d8-b163-48b7-95b8-247177ab2e4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:54.415921 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9504b604-c0b7-42eb-98ad-dd1d3039502a tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 28695 microversion: 2.20 time: 0.074523 Jul 19 09:34:54.419850 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 568/1164] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:54 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 28695 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:34:54.523945 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-40ae60d8-b163-48b7-95b8-247177ab2e4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:54.531535 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-40ae60d8-b163-48b7-95b8-247177ab2e4f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150402 Jul 19 09:34:54.532101 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 597/1165] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:54 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:55.428105 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-50442c11-2269-45c0-afdd-98d399d1c069 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:55.429089 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-50442c11-2269-45c0-afdd-98d399d1c069 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:55.435415 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50442c11-2269-45c0-afdd-98d399d1c069 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:55.435855 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50442c11-2269-45c0-afdd-98d399d1c069 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:55.437290 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50442c11-2269-45c0-afdd-98d399d1c069 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:55.437756 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50442c11-2269-45c0-afdd-98d399d1c069 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:55.500505 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-50442c11-2269-45c0-afdd-98d399d1c069 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 28695 microversion: 2.20 time: 0.076295 Jul 19 09:34:55.501343 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 569/1166] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:55 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 28695 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:34:55.548955 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-54dd6a63-b07f-4625-a603-d5641062d699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:55.549500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-54dd6a63-b07f-4625-a603-d5641062d699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:55.555307 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-54dd6a63-b07f-4625-a603-d5641062d699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:55.555762 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-54dd6a63-b07f-4625-a603-d5641062d699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:55.556506 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-54dd6a63-b07f-4625-a603-d5641062d699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:55.556938 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-54dd6a63-b07f-4625-a603-d5641062d699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:55.684621 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-54dd6a63-b07f-4625-a603-d5641062d699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:55.691737 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-54dd6a63-b07f-4625-a603-d5641062d699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147070 Jul 19 09:34:55.692307 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 598/1167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:55 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:56.512255 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2356dc7d-56e7-4069-9594-3f8dfb846e59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:56.513240 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2356dc7d-56e7-4069-9594-3f8dfb846e59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:56.519511 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2356dc7d-56e7-4069-9594-3f8dfb846e59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:56.519945 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2356dc7d-56e7-4069-9594-3f8dfb846e59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:56.520697 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2356dc7d-56e7-4069-9594-3f8dfb846e59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:56.521126 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2356dc7d-56e7-4069-9594-3f8dfb846e59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:56.581058 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2356dc7d-56e7-4069-9594-3f8dfb846e59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 28695 microversion: 2.20 time: 0.072671 Jul 19 09:34:56.581655 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 570/1168] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:56 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 28695 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:34:56.708628 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c051981b-e8c2-4281-a7b1-e7f223807b04 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:56.709229 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c051981b-e8c2-4281-a7b1-e7f223807b04 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:56.715002 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c051981b-e8c2-4281-a7b1-e7f223807b04 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:56.715477 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c051981b-e8c2-4281-a7b1-e7f223807b04 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:56.716226 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c051981b-e8c2-4281-a7b1-e7f223807b04 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:56.716654 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c051981b-e8c2-4281-a7b1-e7f223807b04 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:56.849223 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c051981b-e8c2-4281-a7b1-e7f223807b04 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:56.856430 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c051981b-e8c2-4281-a7b1-e7f223807b04 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151480 Jul 19 09:34:56.856988 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 599/1169] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:56 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:57.593405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-95016fbc-3758-472f-9db2-48bfd1a372af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:57.594394 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-95016fbc-3758-472f-9db2-48bfd1a372af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:57.600802 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-95016fbc-3758-472f-9db2-48bfd1a372af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:57.601245 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-95016fbc-3758-472f-9db2-48bfd1a372af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:57.602003 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-95016fbc-3758-472f-9db2-48bfd1a372af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:57.602436 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-95016fbc-3758-472f-9db2-48bfd1a372af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:57.665405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-95016fbc-3758-472f-9db2-48bfd1a372af tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 29255 microversion: 2.20 time: 0.076031 Jul 19 09:34:57.666027 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 571/1170] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:57 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 29255 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:34:57.873138 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3dfbb75d-1386-4c0b-abb8-b2b348b1042f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:57.873792 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3dfbb75d-1386-4c0b-abb8-b2b348b1042f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:57.880595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3dfbb75d-1386-4c0b-abb8-b2b348b1042f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:57.881044 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3dfbb75d-1386-4c0b-abb8-b2b348b1042f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:57.881797 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3dfbb75d-1386-4c0b-abb8-b2b348b1042f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:57.882226 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3dfbb75d-1386-4c0b-abb8-b2b348b1042f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:58.011556 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3dfbb75d-1386-4c0b-abb8-b2b348b1042f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:58.018745 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3dfbb75d-1386-4c0b-abb8-b2b348b1042f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149401 Jul 19 09:34:58.019344 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 600/1171] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:57 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:58.677883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b287ac14-9a35-40cf-8ef1-ca2960a04218 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:58.678879 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b287ac14-9a35-40cf-8ef1-ca2960a04218 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:58.685287 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b287ac14-9a35-40cf-8ef1-ca2960a04218 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:58.685743 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b287ac14-9a35-40cf-8ef1-ca2960a04218 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:58.686543 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b287ac14-9a35-40cf-8ef1-ca2960a04218 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:58.686982 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b287ac14-9a35-40cf-8ef1-ca2960a04218 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:58.755398 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b287ac14-9a35-40cf-8ef1-ca2960a04218 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 31442 microversion: 2.20 time: 0.081306 Jul 19 09:34:58.755997 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 572/1172] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:58 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 31442 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:34:59.035490 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-070e1d34-c125-49ad-b176-aa1dad2680f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:34:59.036027 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-070e1d34-c125-49ad-b176-aa1dad2680f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:59.041997 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-070e1d34-c125-49ad-b176-aa1dad2680f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:59.042437 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-070e1d34-c125-49ad-b176-aa1dad2680f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:59.043220 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-070e1d34-c125-49ad-b176-aa1dad2680f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:59.043652 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-070e1d34-c125-49ad-b176-aa1dad2680f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:59.177470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-070e1d34-c125-49ad-b176-aa1dad2680f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:34:59.184740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-070e1d34-c125-49ad-b176-aa1dad2680f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152934 Jul 19 09:34:59.185303 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 601/1173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:34:59 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:34:59.767863 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2224f6fc-1bba-4ef3-b53b-a390dd11f17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:34:59.768852 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2224f6fc-1bba-4ef3-b53b-a390dd11f17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:34:59.775194 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2224f6fc-1bba-4ef3-b53b-a390dd11f17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:59.775640 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2224f6fc-1bba-4ef3-b53b-a390dd11f17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:59.776395 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2224f6fc-1bba-4ef3-b53b-a390dd11f17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:34:59.776825 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2224f6fc-1bba-4ef3-b53b-a390dd11f17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:34:59.837561 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2224f6fc-1bba-4ef3-b53b-a390dd11f17f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 32817 microversion: 2.20 time: 0.074100 Jul 19 09:34:59.838120 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 573/1174] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:34:59 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 32817 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:35:00.201858 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7d9d9aa6-e8f6-4c1e-a9c6-d197eaa562e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:00.202958 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7d9d9aa6-e8f6-4c1e-a9c6-d197eaa562e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:00.208763 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7d9d9aa6-e8f6-4c1e-a9c6-d197eaa562e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:00.209208 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7d9d9aa6-e8f6-4c1e-a9c6-d197eaa562e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:00.209963 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7d9d9aa6-e8f6-4c1e-a9c6-d197eaa562e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:00.210392 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7d9d9aa6-e8f6-4c1e-a9c6-d197eaa562e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:00.341144 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7d9d9aa6-e8f6-4c1e-a9c6-d197eaa562e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:00.348393 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7d9d9aa6-e8f6-4c1e-a9c6-d197eaa562e2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150295 Jul 19 09:35:00.348960 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 602/1175] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:00 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:00.849926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-91fef8b5-f356-4a7d-8f00-c7e2628614ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:35:00.850850 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-91fef8b5-f356-4a7d-8f00-c7e2628614ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:00.857288 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-91fef8b5-f356-4a7d-8f00-c7e2628614ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:00.857734 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-91fef8b5-f356-4a7d-8f00-c7e2628614ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:00.859095 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-91fef8b5-f356-4a7d-8f00-c7e2628614ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:00.859533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-91fef8b5-f356-4a7d-8f00-c7e2628614ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:00.919831 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-91fef8b5-f356-4a7d-8f00-c7e2628614ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 33786 microversion: 2.20 time: 0.073926 Jul 19 09:35:00.920553 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 574/1176] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:35:00 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 33786 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:35:01.364928 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0053cba1-674e-46a6-9fa9-0cce864ef0ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:01.365559 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0053cba1-674e-46a6-9fa9-0cce864ef0ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:01.371377 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0053cba1-674e-46a6-9fa9-0cce864ef0ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:01.371831 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0053cba1-674e-46a6-9fa9-0cce864ef0ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:01.372582 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0053cba1-674e-46a6-9fa9-0cce864ef0ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:01.373013 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0053cba1-674e-46a6-9fa9-0cce864ef0ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:01.507232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0053cba1-674e-46a6-9fa9-0cce864ef0ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:01.514639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0053cba1-674e-46a6-9fa9-0cce864ef0ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.153252 Jul 19 09:35:01.515247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 603/1177] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:01 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:01.932822 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-efee9ff3-8b90-4e02-8d6e-c034c9855e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:35:01.933746 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-efee9ff3-8b90-4e02-8d6e-c034c9855e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:01.940716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-efee9ff3-8b90-4e02-8d6e-c034c9855e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:01.941165 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-efee9ff3-8b90-4e02-8d6e-c034c9855e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:01.941923 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-efee9ff3-8b90-4e02-8d6e-c034c9855e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:01.942354 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-efee9ff3-8b90-4e02-8d6e-c034c9855e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:02.003998 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-efee9ff3-8b90-4e02-8d6e-c034c9855e9c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 35239 microversion: 2.20 time: 0.075210 Jul 19 09:35:02.004632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 575/1178] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:35:01 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 35239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:35:02.532069 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1ec4b8fe-2541-4a9d-a577-83058b871c08 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:02.532672 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1ec4b8fe-2541-4a9d-a577-83058b871c08 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:02.538518 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ec4b8fe-2541-4a9d-a577-83058b871c08 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:02.538964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ec4b8fe-2541-4a9d-a577-83058b871c08 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:02.539740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ec4b8fe-2541-4a9d-a577-83058b871c08 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:02.540167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1ec4b8fe-2541-4a9d-a577-83058b871c08 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:02.672658 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1ec4b8fe-2541-4a9d-a577-83058b871c08 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:02.679969 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1ec4b8fe-2541-4a9d-a577-83058b871c08 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151958 Jul 19 09:35:02.680537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 604/1179] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:02 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:03.016287 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0d4c7886-1fda-4c79-a7da-9424b7efaa37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:35:03.017227 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0d4c7886-1fda-4c79-a7da-9424b7efaa37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:03.023662 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0d4c7886-1fda-4c79-a7da-9424b7efaa37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:03.024121 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0d4c7886-1fda-4c79-a7da-9424b7efaa37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:03.024895 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0d4c7886-1fda-4c79-a7da-9424b7efaa37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:03.025334 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0d4c7886-1fda-4c79-a7da-9424b7efaa37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:03.086956 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0d4c7886-1fda-4c79-a7da-9424b7efaa37 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 36785 microversion: 2.20 time: 0.075363 Jul 19 09:35:03.087618 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 576/1180] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:35:03 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 36785 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:35:03.695865 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-aba404b2-9594-4a7a-8b4e-f5672fa50432 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:03.696476 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-aba404b2-9594-4a7a-8b4e-f5672fa50432 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:03.702268 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aba404b2-9594-4a7a-8b4e-f5672fa50432 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:03.702709 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aba404b2-9594-4a7a-8b4e-f5672fa50432 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:03.703505 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aba404b2-9594-4a7a-8b4e-f5672fa50432 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:03.703934 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aba404b2-9594-4a7a-8b4e-f5672fa50432 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:03.835877 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-aba404b2-9594-4a7a-8b4e-f5672fa50432 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:03.843567 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-aba404b2-9594-4a7a-8b4e-f5672fa50432 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151391 Jul 19 09:35:03.844116 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 605/1181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:03 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:35:04.098670 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-18a2d6fa-7186-4590-a68d-78bcec27cc11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:35:04.099624 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-18a2d6fa-7186-4590-a68d-78bcec27cc11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:04.106033 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-18a2d6fa-7186-4590-a68d-78bcec27cc11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:04.106489 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-18a2d6fa-7186-4590-a68d-78bcec27cc11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:04.107291 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-18a2d6fa-7186-4590-a68d-78bcec27cc11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:04.107735 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-18a2d6fa-7186-4590-a68d-78bcec27cc11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:04.168691 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-18a2d6fa-7186-4590-a68d-78bcec27cc11 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 38247 microversion: 2.20 time: 0.073992 Jul 19 09:35:04.169369 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 577/1182] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:35:04 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 38247 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:35:04.860036 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c319e23f-e6f8-4cca-992d-e43cfe104563 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:04.860578 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c319e23f-e6f8-4cca-992d-e43cfe104563 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:04.866131 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c319e23f-e6f8-4cca-992d-e43cfe104563 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:04.866579 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c319e23f-e6f8-4cca-992d-e43cfe104563 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:04.867352 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c319e23f-e6f8-4cca-992d-e43cfe104563 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:04.867777 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c319e23f-e6f8-4cca-992d-e43cfe104563 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:05.001459 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c319e23f-e6f8-4cca-992d-e43cfe104563 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:05.008602 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c319e23f-e6f8-4cca-992d-e43cfe104563 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152227 Jul 19 09:35:05.009161 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 606/1183] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:04 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:05.181292 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8562fab2-241d-46bd-8fe4-04c831b834ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:35:05.182290 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8562fab2-241d-46bd-8fe4-04c831b834ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:05.189287 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8562fab2-241d-46bd-8fe4-04c831b834ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:05.189741 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8562fab2-241d-46bd-8fe4-04c831b834ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:05.190508 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8562fab2-241d-46bd-8fe4-04c831b834ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:05.190942 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8562fab2-241d-46bd-8fe4-04c831b834ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:05.255412 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8562fab2-241d-46bd-8fe4-04c831b834ef tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 38249 microversion: 2.20 time: 0.078057 Jul 19 09:35:05.256031 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 578/1184] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:35:05 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 38249 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:35:06.025623 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-dcf3a37a-7255-42ef-88af-e70543ef5f9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:06.026218 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-dcf3a37a-7255-42ef-88af-e70543ef5f9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:06.032266 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dcf3a37a-7255-42ef-88af-e70543ef5f9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:06.032710 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dcf3a37a-7255-42ef-88af-e70543ef5f9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:06.033459 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dcf3a37a-7255-42ef-88af-e70543ef5f9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:06.033883 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dcf3a37a-7255-42ef-88af-e70543ef5f9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:06.165833 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-dcf3a37a-7255-42ef-88af-e70543ef5f9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:06.173072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-dcf3a37a-7255-42ef-88af-e70543ef5f9a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151380 Jul 19 09:35:06.173664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 607/1185] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:06 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:06.268745 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2c5b4853-f920-4845-8d77-43f07cff0f25 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:35:06.269735 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2c5b4853-f920-4845-8d77-43f07cff0f25 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:06.276137 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2c5b4853-f920-4845-8d77-43f07cff0f25 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:06.276578 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2c5b4853-f920-4845-8d77-43f07cff0f25 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:06.277330 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2c5b4853-f920-4845-8d77-43f07cff0f25 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:06.277757 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2c5b4853-f920-4845-8d77-43f07cff0f25 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:06.337451 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2c5b4853-f920-4845-8d77-43f07cff0f25 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 38249 microversion: 2.20 time: 0.073835 Jul 19 09:35:06.338116 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 579/1186] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:35:06 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 38249 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:35:07.189475 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3bac392c-1377-4560-8bbb-804553203a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:07.190019 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3bac392c-1377-4560-8bbb-804553203a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:07.195840 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3bac392c-1377-4560-8bbb-804553203a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:07.196283 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3bac392c-1377-4560-8bbb-804553203a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:07.197032 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3bac392c-1377-4560-8bbb-804553203a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:07.197458 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3bac392c-1377-4560-8bbb-804553203a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:07.325171 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3bac392c-1377-4560-8bbb-804553203a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:07.332900 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3bac392c-1377-4560-8bbb-804553203a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147145 Jul 19 09:35:07.333456 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 608/1187] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:07 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:07.350543 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-97ff0174-9ba2-4463-9d01-410fe607c43f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:35:07.351584 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-97ff0174-9ba2-4463-9d01-410fe607c43f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:07.357901 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97ff0174-9ba2-4463-9d01-410fe607c43f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:07.358352 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97ff0174-9ba2-4463-9d01-410fe607c43f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:07.359178 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97ff0174-9ba2-4463-9d01-410fe607c43f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:07.359615 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97ff0174-9ba2-4463-9d01-410fe607c43f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:07.418826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-97ff0174-9ba2-4463-9d01-410fe607c43f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 38249 microversion: 2.20 time: 0.072158 Jul 19 09:35:07.419485 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 580/1188] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:35:07 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 38249 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:35:08.349329 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-643507ba-2aae-456f-8abb-ff945b794f55 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:08.349977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-643507ba-2aae-456f-8abb-ff945b794f55 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:08.355891 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-643507ba-2aae-456f-8abb-ff945b794f55 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:08.356334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-643507ba-2aae-456f-8abb-ff945b794f55 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:08.357080 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-643507ba-2aae-456f-8abb-ff945b794f55 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:08.357505 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-643507ba-2aae-456f-8abb-ff945b794f55 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:08.431302 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-524bee96-161b-422d-9250-05a635858e1d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:35:08.432393 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-524bee96-161b-422d-9250-05a635858e1d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:08.439599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-524bee96-161b-422d-9250-05a635858e1d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:08.440045 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-524bee96-161b-422d-9250-05a635858e1d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:08.440822 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-524bee96-161b-422d-9250-05a635858e1d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:08.441253 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-524bee96-161b-422d-9250-05a635858e1d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:08.492590 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-643507ba-2aae-456f-8abb-ff945b794f55 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:08.500340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-643507ba-2aae-456f-8abb-ff945b794f55 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.154661 Jul 19 09:35:08.501310 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 609/1189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:08 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:08.503686 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-524bee96-161b-422d-9250-05a635858e1d tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action" status: 200 len: 38390 microversion: 2.20 time: 0.076224 Jul 19 09:35:08.504326 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 581/1190] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Jul 19 09:35:08 2021] POST /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/action => generated 38390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 19 09:35:08.513472 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8df34b51-3694-436c-9d68-3dfb14bdfb5f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:08.513983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8df34b51-3694-436c-9d68-3dfb14bdfb5f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:08.519620 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8df34b51-3694-436c-9d68-3dfb14bdfb5f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:08.520064 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8df34b51-3694-436c-9d68-3dfb14bdfb5f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:08.520812 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8df34b51-3694-436c-9d68-3dfb14bdfb5f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:08.521238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8df34b51-3694-436c-9d68-3dfb14bdfb5f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:08.543924 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8df34b51-3694-436c-9d68-3dfb14bdfb5f tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/ips" status: 200 len: 152 microversion: 2.20 time: 0.033863 Jul 19 09:35:08.544464 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 610/1191] 10.222.0.16 () {60 vars in 1289 bytes} [Mon Jul 19 09:35:08 2021] GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99/ips => generated 152 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:35:09.518576 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-17cac052-7136-4ebc-bc3b-5f299360ee0b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:09.519228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-17cac052-7136-4ebc-bc3b-5f299360ee0b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:09.525580 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-17cac052-7136-4ebc-bc3b-5f299360ee0b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:09.526025 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-17cac052-7136-4ebc-bc3b-5f299360ee0b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:09.526785 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-17cac052-7136-4ebc-bc3b-5f299360ee0b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:09.527246 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-17cac052-7136-4ebc-bc3b-5f299360ee0b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:09.662494 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-17cac052-7136-4ebc-bc3b-5f299360ee0b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:09.670167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-17cac052-7136-4ebc-bc3b-5f299360ee0b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.156161 Jul 19 09:35:09.670749 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 582/1192] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:09 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:10.686783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-62519b64-8f43-4153-9447-6a8f8008a3ba tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:10.687414 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-62519b64-8f43-4153-9447-6a8f8008a3ba tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:10.693224 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62519b64-8f43-4153-9447-6a8f8008a3ba tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:10.693664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62519b64-8f43-4153-9447-6a8f8008a3ba tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:10.694412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62519b64-8f43-4153-9447-6a8f8008a3ba tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:10.694838 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62519b64-8f43-4153-9447-6a8f8008a3ba tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:10.823483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-62519b64-8f43-4153-9447-6a8f8008a3ba tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:10.830545 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-62519b64-8f43-4153-9447-6a8f8008a3ba tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147550 Jul 19 09:35:10.831117 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 611/1193] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:10 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:11.847077 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bc273e38-0288-49b7-81ff-44f545d53afb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:11.847737 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bc273e38-0288-49b7-81ff-44f545d53afb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:11.853856 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc273e38-0288-49b7-81ff-44f545d53afb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:11.854299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc273e38-0288-49b7-81ff-44f545d53afb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:11.855077 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc273e38-0288-49b7-81ff-44f545d53afb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:11.855511 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc273e38-0288-49b7-81ff-44f545d53afb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:11.991112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bc273e38-0288-49b7-81ff-44f545d53afb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:12.002139 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bc273e38-0288-49b7-81ff-44f545d53afb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.155207 Jul 19 09:35:12.002139 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 583/1194] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:11 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:13.014544 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f1001c56-cb76-4451-86a1-77956dc34223 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:13.015740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f1001c56-cb76-4451-86a1-77956dc34223 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:13.021419 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f1001c56-cb76-4451-86a1-77956dc34223 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:13.021868 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f1001c56-cb76-4451-86a1-77956dc34223 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:13.022626 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f1001c56-cb76-4451-86a1-77956dc34223 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:13.023063 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f1001c56-cb76-4451-86a1-77956dc34223 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:13.159228 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f1001c56-cb76-4451-86a1-77956dc34223 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:13.166825 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f1001c56-cb76-4451-86a1-77956dc34223 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.155818 Jul 19 09:35:13.167566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 612/1195] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:13 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:14.183934 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bce3d970-c9e5-4e4b-b339-e72307086c2b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:14.184474 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bce3d970-c9e5-4e4b-b339-e72307086c2b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:14.191674 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bce3d970-c9e5-4e4b-b339-e72307086c2b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:14.192124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bce3d970-c9e5-4e4b-b339-e72307086c2b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:14.192892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bce3d970-c9e5-4e4b-b339-e72307086c2b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:14.193359 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bce3d970-c9e5-4e4b-b339-e72307086c2b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:14.380912 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bce3d970-c9e5-4e4b-b339-e72307086c2b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:14.388048 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bce3d970-c9e5-4e4b-b339-e72307086c2b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.207831 Jul 19 09:35:14.388598 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 584/1196] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:14 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:35:15.404269 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-62a34868-d8b0-49b5-be05-e248928479ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:15.404876 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-62a34868-d8b0-49b5-be05-e248928479ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:15.410543 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62a34868-d8b0-49b5-be05-e248928479ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:15.410998 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62a34868-d8b0-49b5-be05-e248928479ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:15.411791 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62a34868-d8b0-49b5-be05-e248928479ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:15.412227 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62a34868-d8b0-49b5-be05-e248928479ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:15.582802 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-62a34868-d8b0-49b5-be05-e248928479ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:15.589982 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-62a34868-d8b0-49b5-be05-e248928479ac tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.189312 Jul 19 09:35:15.590552 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 613/1197] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:15 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:16.606582 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-690210b5-e4a1-4723-8da6-de1265a3ca18 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:16.607222 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-690210b5-e4a1-4723-8da6-de1265a3ca18 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:16.613068 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-690210b5-e4a1-4723-8da6-de1265a3ca18 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:16.613473 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-690210b5-e4a1-4723-8da6-de1265a3ca18 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:16.614238 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-690210b5-e4a1-4723-8da6-de1265a3ca18 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:16.614675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-690210b5-e4a1-4723-8da6-de1265a3ca18 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:16.744250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-690210b5-e4a1-4723-8da6-de1265a3ca18 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:16.751920 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-690210b5-e4a1-4723-8da6-de1265a3ca18 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148951 Jul 19 09:35:16.752477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 585/1198] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:16 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:17.769229 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-116a0810-7fbf-4b74-9c72-b3411984fae8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:17.769771 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-116a0810-7fbf-4b74-9c72-b3411984fae8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:17.775451 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-116a0810-7fbf-4b74-9c72-b3411984fae8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:17.775892 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-116a0810-7fbf-4b74-9c72-b3411984fae8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:17.776639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-116a0810-7fbf-4b74-9c72-b3411984fae8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:17.777067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-116a0810-7fbf-4b74-9c72-b3411984fae8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:17.906326 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-116a0810-7fbf-4b74-9c72-b3411984fae8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:17.913743 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-116a0810-7fbf-4b74-9c72-b3411984fae8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148668 Jul 19 09:35:17.914304 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 614/1199] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:17 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:18.930599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1a32d937-efca-4674-87f7-7cdbf32477c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:18.931264 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1a32d937-efca-4674-87f7-7cdbf32477c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:18.937426 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1a32d937-efca-4674-87f7-7cdbf32477c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:18.937901 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1a32d937-efca-4674-87f7-7cdbf32477c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:18.938660 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1a32d937-efca-4674-87f7-7cdbf32477c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:18.939120 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1a32d937-efca-4674-87f7-7cdbf32477c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:19.070657 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1a32d937-efca-4674-87f7-7cdbf32477c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:19.077806 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1a32d937-efca-4674-87f7-7cdbf32477c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150872 Jul 19 09:35:19.078383 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 586/1200] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:18 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:20.094377 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b23eb744-4daa-400f-80ed-43b3573c3c48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:20.094992 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b23eb744-4daa-400f-80ed-43b3573c3c48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:20.100801 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b23eb744-4daa-400f-80ed-43b3573c3c48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:20.101254 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b23eb744-4daa-400f-80ed-43b3573c3c48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:20.102100 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b23eb744-4daa-400f-80ed-43b3573c3c48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:20.102537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b23eb744-4daa-400f-80ed-43b3573c3c48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:20.236311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b23eb744-4daa-400f-80ed-43b3573c3c48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:20.243497 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b23eb744-4daa-400f-80ed-43b3573c3c48 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152785 Jul 19 09:35:20.244066 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 615/1201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:20 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:21.260340 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3d0d7d53-8f08-4a2b-8fa5-27872d87126c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:21.260933 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3d0d7d53-8f08-4a2b-8fa5-27872d87126c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:21.267169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3d0d7d53-8f08-4a2b-8fa5-27872d87126c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:21.267619 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3d0d7d53-8f08-4a2b-8fa5-27872d87126c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:21.268364 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3d0d7d53-8f08-4a2b-8fa5-27872d87126c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:21.268791 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3d0d7d53-8f08-4a2b-8fa5-27872d87126c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:21.403388 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3d0d7d53-8f08-4a2b-8fa5-27872d87126c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:21.410928 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3d0d7d53-8f08-4a2b-8fa5-27872d87126c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.154228 Jul 19 09:35:21.411513 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 587/1202] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:21 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:22.428555 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f2396643-1ac3-405d-9abe-bccebadb71a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:22.429379 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f2396643-1ac3-405d-9abe-bccebadb71a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:22.435251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2396643-1ac3-405d-9abe-bccebadb71a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:22.435712 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2396643-1ac3-405d-9abe-bccebadb71a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:22.436536 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2396643-1ac3-405d-9abe-bccebadb71a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:22.437509 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2396643-1ac3-405d-9abe-bccebadb71a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:22.570730 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f2396643-1ac3-405d-9abe-bccebadb71a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:22.578045 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f2396643-1ac3-405d-9abe-bccebadb71a6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.153437 Jul 19 09:35:22.578603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 616/1203] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:22 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:23.593937 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-410f35bd-a3ba-42e7-bee6-0406d9018816 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:23.594575 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-410f35bd-a3ba-42e7-bee6-0406d9018816 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:23.600300 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-410f35bd-a3ba-42e7-bee6-0406d9018816 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:23.600748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-410f35bd-a3ba-42e7-bee6-0406d9018816 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:23.601507 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-410f35bd-a3ba-42e7-bee6-0406d9018816 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:23.601941 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-410f35bd-a3ba-42e7-bee6-0406d9018816 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:23.730774 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-410f35bd-a3ba-42e7-bee6-0406d9018816 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:23.738636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-410f35bd-a3ba-42e7-bee6-0406d9018816 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148265 Jul 19 09:35:23.739230 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 588/1204] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:23 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:24.755532 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-44cf0e47-993d-4c4b-a8f0-fcf4c3ad9615 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:24.756073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-44cf0e47-993d-4c4b-a8f0-fcf4c3ad9615 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:24.761984 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44cf0e47-993d-4c4b-a8f0-fcf4c3ad9615 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:24.762437 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44cf0e47-993d-4c4b-a8f0-fcf4c3ad9615 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:24.763233 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44cf0e47-993d-4c4b-a8f0-fcf4c3ad9615 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:24.763666 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44cf0e47-993d-4c4b-a8f0-fcf4c3ad9615 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:24.899774 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-44cf0e47-993d-4c4b-a8f0-fcf4c3ad9615 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:24.906941 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-44cf0e47-993d-4c4b-a8f0-fcf4c3ad9615 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.155075 Jul 19 09:35:24.907570 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 617/1205] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:24 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:25.923636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f30228f4-8efd-4703-a51f-238753ead6ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:25.924240 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f30228f4-8efd-4703-a51f-238753ead6ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:25.929911 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f30228f4-8efd-4703-a51f-238753ead6ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:25.930360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f30228f4-8efd-4703-a51f-238753ead6ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:25.931153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f30228f4-8efd-4703-a51f-238753ead6ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:25.931585 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f30228f4-8efd-4703-a51f-238753ead6ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:26.066673 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f30228f4-8efd-4703-a51f-238753ead6ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:26.073917 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f30228f4-8efd-4703-a51f-238753ead6ef tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.153876 Jul 19 09:35:26.074477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 589/1206] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:25 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:27.091276 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a6880768-616e-48dc-acc2-8d23bcc2ee47 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:27.091866 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a6880768-616e-48dc-acc2-8d23bcc2ee47 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:27.097991 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a6880768-616e-48dc-acc2-8d23bcc2ee47 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:27.098433 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a6880768-616e-48dc-acc2-8d23bcc2ee47 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:27.099207 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a6880768-616e-48dc-acc2-8d23bcc2ee47 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:27.099639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a6880768-616e-48dc-acc2-8d23bcc2ee47 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:27.230081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a6880768-616e-48dc-acc2-8d23bcc2ee47 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:27.237810 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a6880768-616e-48dc-acc2-8d23bcc2ee47 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150180 Jul 19 09:35:27.238365 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 618/1207] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:27 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:28.254968 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-55f6d25a-2710-4dda-a5fe-696928dfd510 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:28.255608 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-55f6d25a-2710-4dda-a5fe-696928dfd510 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:28.261817 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-55f6d25a-2710-4dda-a5fe-696928dfd510 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:28.262263 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-55f6d25a-2710-4dda-a5fe-696928dfd510 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:28.263025 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-55f6d25a-2710-4dda-a5fe-696928dfd510 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:28.263480 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-55f6d25a-2710-4dda-a5fe-696928dfd510 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:28.392397 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-55f6d25a-2710-4dda-a5fe-696928dfd510 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:28.399683 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-55f6d25a-2710-4dda-a5fe-696928dfd510 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148343 Jul 19 09:35:28.400241 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 590/1208] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:28 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:29.416370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cdd7f29d-e5d7-4817-9d10-403670eb72e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:29.416974 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-cdd7f29d-e5d7-4817-9d10-403670eb72e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:29.423482 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdd7f29d-e5d7-4817-9d10-403670eb72e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:29.423930 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdd7f29d-e5d7-4817-9d10-403670eb72e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:29.424685 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdd7f29d-e5d7-4817-9d10-403670eb72e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:29.425116 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdd7f29d-e5d7-4817-9d10-403670eb72e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:29.553492 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cdd7f29d-e5d7-4817-9d10-403670eb72e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:29.560591 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-cdd7f29d-e5d7-4817-9d10-403670eb72e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.148092 Jul 19 09:35:29.561185 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 619/1209] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:29 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:30.577317 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-023d763f-45ad-49c7-95d1-01fcb9ca5166 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:30.577929 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-023d763f-45ad-49c7-95d1-01fcb9ca5166 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:30.583744 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-023d763f-45ad-49c7-95d1-01fcb9ca5166 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:30.584193 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-023d763f-45ad-49c7-95d1-01fcb9ca5166 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:30.584954 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-023d763f-45ad-49c7-95d1-01fcb9ca5166 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:30.585390 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-023d763f-45ad-49c7-95d1-01fcb9ca5166 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:30.716681 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-023d763f-45ad-49c7-95d1-01fcb9ca5166 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:30.724474 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-023d763f-45ad-49c7-95d1-01fcb9ca5166 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150870 Jul 19 09:35:30.725036 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 591/1210] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:30 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:31.741444 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c1696f24-85a1-47eb-b34b-7346153f6dde tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:31.743342 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c1696f24-85a1-47eb-b34b-7346153f6dde tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:31.748399 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1696f24-85a1-47eb-b34b-7346153f6dde tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:31.749347 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1696f24-85a1-47eb-b34b-7346153f6dde tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:31.750110 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1696f24-85a1-47eb-b34b-7346153f6dde tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:31.750545 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1696f24-85a1-47eb-b34b-7346153f6dde tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:31.882853 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c1696f24-85a1-47eb-b34b-7346153f6dde tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:31.890264 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c1696f24-85a1-47eb-b34b-7346153f6dde tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152501 Jul 19 09:35:31.890822 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 620/1211] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:31 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:32.905864 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-860ea25c-7508-45fc-b70a-589b4f3b64cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:32.906467 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-860ea25c-7508-45fc-b70a-589b4f3b64cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:32.912195 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-860ea25c-7508-45fc-b70a-589b4f3b64cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:32.912943 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-860ea25c-7508-45fc-b70a-589b4f3b64cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:32.913653 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-860ea25c-7508-45fc-b70a-589b4f3b64cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:32.914093 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-860ea25c-7508-45fc-b70a-589b4f3b64cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:33.048473 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-860ea25c-7508-45fc-b70a-589b4f3b64cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:33.055703 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-860ea25c-7508-45fc-b70a-589b4f3b64cd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.153413 Jul 19 09:35:33.056272 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 592/1212] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:32 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:34.072230 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f380ac10-b099-4187-948e-748166d4daee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:34.072833 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f380ac10-b099-4187-948e-748166d4daee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:34.079112 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f380ac10-b099-4187-948e-748166d4daee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:34.079557 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f380ac10-b099-4187-948e-748166d4daee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:34.080308 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f380ac10-b099-4187-948e-748166d4daee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:34.080735 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f380ac10-b099-4187-948e-748166d4daee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:34.210996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f380ac10-b099-4187-948e-748166d4daee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:34.218298 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f380ac10-b099-4187-948e-748166d4daee tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149701 Jul 19 09:35:34.218994 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 621/1213] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:34 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:35.235265 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2ae31e63-418a-42e7-8fef-f48af458d570 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:35.235869 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2ae31e63-418a-42e7-8fef-f48af458d570 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:35.241544 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2ae31e63-418a-42e7-8fef-f48af458d570 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:35.241991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2ae31e63-418a-42e7-8fef-f48af458d570 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:35.242748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2ae31e63-418a-42e7-8fef-f48af458d570 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:35.243209 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2ae31e63-418a-42e7-8fef-f48af458d570 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:35.373355 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2ae31e63-418a-42e7-8fef-f48af458d570 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:35.380876 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2ae31e63-418a-42e7-8fef-f48af458d570 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149793 Jul 19 09:35:35.381570 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 593/1214] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:35 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:36.397044 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e20b52f4-9c79-4880-b1ed-1f478742de89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:36.397735 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e20b52f4-9c79-4880-b1ed-1f478742de89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:36.403427 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e20b52f4-9c79-4880-b1ed-1f478742de89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:36.403886 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e20b52f4-9c79-4880-b1ed-1f478742de89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:36.404727 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e20b52f4-9c79-4880-b1ed-1f478742de89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:36.405072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e20b52f4-9c79-4880-b1ed-1f478742de89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:36.542094 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e20b52f4-9c79-4880-b1ed-1f478742de89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:36.549915 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e20b52f4-9c79-4880-b1ed-1f478742de89 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.156467 Jul 19 09:35:36.550476 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 622/1215] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:36 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:37.566964 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8c65fff8-17ac-4228-8607-b6649251e4af tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:37.567641 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8c65fff8-17ac-4228-8607-b6649251e4af tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:37.573249 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8c65fff8-17ac-4228-8607-b6649251e4af tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:37.573698 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8c65fff8-17ac-4228-8607-b6649251e4af tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:37.574462 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8c65fff8-17ac-4228-8607-b6649251e4af tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:37.574898 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8c65fff8-17ac-4228-8607-b6649251e4af tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:37.707244 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8c65fff8-17ac-4228-8607-b6649251e4af tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:37.714418 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8c65fff8-17ac-4228-8607-b6649251e4af tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151176 Jul 19 09:35:37.714981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 594/1216] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:37 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:38.731306 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-382ce612-41bd-4e4a-beab-41d25b3e0de6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:38.731803 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-382ce612-41bd-4e4a-beab-41d25b3e0de6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:38.738210 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-382ce612-41bd-4e4a-beab-41d25b3e0de6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:38.738672 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-382ce612-41bd-4e4a-beab-41d25b3e0de6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:38.739485 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-382ce612-41bd-4e4a-beab-41d25b3e0de6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:38.739950 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-382ce612-41bd-4e4a-beab-41d25b3e0de6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:38.869381 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-382ce612-41bd-4e4a-beab-41d25b3e0de6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:38.877174 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-382ce612-41bd-4e4a-beab-41d25b3e0de6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149849 Jul 19 09:35:38.877739 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 623/1217] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:38 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:39.893839 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fc226f2a-d272-4456-9ca8-b9de03a22929 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:39.894375 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fc226f2a-d272-4456-9ca8-b9de03a22929 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:39.900077 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc226f2a-d272-4456-9ca8-b9de03a22929 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:39.900531 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc226f2a-d272-4456-9ca8-b9de03a22929 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:39.901329 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc226f2a-d272-4456-9ca8-b9de03a22929 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:39.901768 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc226f2a-d272-4456-9ca8-b9de03a22929 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:40.032282 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fc226f2a-d272-4456-9ca8-b9de03a22929 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:40.039738 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fc226f2a-d272-4456-9ca8-b9de03a22929 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149640 Jul 19 09:35:40.040300 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 595/1218] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:39 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:41.057038 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-597d3d87-d3b0-498d-a8b0-2532f1d2b37a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:41.057571 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-597d3d87-d3b0-498d-a8b0-2532f1d2b37a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:41.063386 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-597d3d87-d3b0-498d-a8b0-2532f1d2b37a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:41.063832 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-597d3d87-d3b0-498d-a8b0-2532f1d2b37a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:41.064584 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-597d3d87-d3b0-498d-a8b0-2532f1d2b37a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:41.065012 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-597d3d87-d3b0-498d-a8b0-2532f1d2b37a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:41.195604 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-597d3d87-d3b0-498d-a8b0-2532f1d2b37a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:41.203272 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-597d3d87-d3b0-498d-a8b0-2532f1d2b37a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149906 Jul 19 09:35:41.203824 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 624/1219] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:41 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:42.220574 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-615f8ce9-c292-41cc-9e5f-d56ea7cd5786 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:42.221187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-615f8ce9-c292-41cc-9e5f-d56ea7cd5786 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:42.227223 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-615f8ce9-c292-41cc-9e5f-d56ea7cd5786 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:42.227679 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-615f8ce9-c292-41cc-9e5f-d56ea7cd5786 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:42.228450 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-615f8ce9-c292-41cc-9e5f-d56ea7cd5786 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:42.228886 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-615f8ce9-c292-41cc-9e5f-d56ea7cd5786 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:42.362722 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-615f8ce9-c292-41cc-9e5f-d56ea7cd5786 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:42.370072 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-615f8ce9-c292-41cc-9e5f-d56ea7cd5786 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.153792 Jul 19 09:35:42.370670 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 596/1220] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:42 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:43.386731 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c8d6e79f-b6d2-444c-a4d3-bd59214d54f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:43.387372 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c8d6e79f-b6d2-444c-a4d3-bd59214d54f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:43.393659 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c8d6e79f-b6d2-444c-a4d3-bd59214d54f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:43.394107 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c8d6e79f-b6d2-444c-a4d3-bd59214d54f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:43.394867 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c8d6e79f-b6d2-444c-a4d3-bd59214d54f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:43.395338 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c8d6e79f-b6d2-444c-a4d3-bd59214d54f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:43.529040 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c8d6e79f-b6d2-444c-a4d3-bd59214d54f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:43.536269 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c8d6e79f-b6d2-444c-a4d3-bd59214d54f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.153219 Jul 19 09:35:43.536836 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 625/1221] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:43 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:44.553178 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-157926ee-7665-4335-a986-5e219d9bcc28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:44.553783 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-157926ee-7665-4335-a986-5e219d9bcc28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:44.559948 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-157926ee-7665-4335-a986-5e219d9bcc28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:44.560397 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-157926ee-7665-4335-a986-5e219d9bcc28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:44.561155 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-157926ee-7665-4335-a986-5e219d9bcc28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:44.561590 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-157926ee-7665-4335-a986-5e219d9bcc28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:44.694043 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-157926ee-7665-4335-a986-5e219d9bcc28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:44.701740 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-157926ee-7665-4335-a986-5e219d9bcc28 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151646 Jul 19 09:35:44.702304 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 597/1222] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:44 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:45.717764 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3cc95a2a-2d19-4825-b38b-bc7049e96302 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:45.718396 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3cc95a2a-2d19-4825-b38b-bc7049e96302 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:45.724266 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3cc95a2a-2d19-4825-b38b-bc7049e96302 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:45.724717 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3cc95a2a-2d19-4825-b38b-bc7049e96302 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:45.725477 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3cc95a2a-2d19-4825-b38b-bc7049e96302 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:45.725910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3cc95a2a-2d19-4825-b38b-bc7049e96302 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:45.862732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3cc95a2a-2d19-4825-b38b-bc7049e96302 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:45.870023 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3cc95a2a-2d19-4825-b38b-bc7049e96302 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.155901 Jul 19 09:35:45.870586 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 626/1223] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:45 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:46.888625 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1c3f792d-1025-4d19-bae6-76865aa77ce3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:46.889164 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1c3f792d-1025-4d19-bae6-76865aa77ce3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:46.895349 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c3f792d-1025-4d19-bae6-76865aa77ce3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:46.895795 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c3f792d-1025-4d19-bae6-76865aa77ce3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:46.896548 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c3f792d-1025-4d19-bae6-76865aa77ce3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:46.896975 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c3f792d-1025-4d19-bae6-76865aa77ce3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:47.028874 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1c3f792d-1025-4d19-bae6-76865aa77ce3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:47.037049 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1c3f792d-1025-4d19-bae6-76865aa77ce3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152081 Jul 19 09:35:47.037883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 598/1224] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:46 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:48.053306 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b2497ed0-06fb-495c-92e1-0c08234890b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:48.053977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b2497ed0-06fb-495c-92e1-0c08234890b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:48.059610 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b2497ed0-06fb-495c-92e1-0c08234890b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:48.060057 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b2497ed0-06fb-495c-92e1-0c08234890b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:48.060806 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b2497ed0-06fb-495c-92e1-0c08234890b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:48.061267 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b2497ed0-06fb-495c-92e1-0c08234890b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:48.198158 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b2497ed0-06fb-495c-92e1-0c08234890b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:48.205491 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b2497ed0-06fb-495c-92e1-0c08234890b7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.155860 Jul 19 09:35:48.206060 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 627/1225] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:48 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:49.221884 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-88b7ef37-1b16-4659-aff7-37f7963fedf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:49.222492 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-88b7ef37-1b16-4659-aff7-37f7963fedf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:49.228170 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-88b7ef37-1b16-4659-aff7-37f7963fedf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:49.228610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-88b7ef37-1b16-4659-aff7-37f7963fedf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:49.229361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-88b7ef37-1b16-4659-aff7-37f7963fedf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:49.229794 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-88b7ef37-1b16-4659-aff7-37f7963fedf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:49.361917 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-88b7ef37-1b16-4659-aff7-37f7963fedf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:49.369074 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-88b7ef37-1b16-4659-aff7-37f7963fedf1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150775 Jul 19 09:35:49.369631 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 599/1226] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:49 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:50.386116 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e13af958-4e4e-41bc-98f3-b85dfcb403f4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:50.386664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e13af958-4e4e-41bc-98f3-b85dfcb403f4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:50.393022 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e13af958-4e4e-41bc-98f3-b85dfcb403f4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:50.393476 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e13af958-4e4e-41bc-98f3-b85dfcb403f4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:50.394231 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e13af958-4e4e-41bc-98f3-b85dfcb403f4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:50.394907 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e13af958-4e4e-41bc-98f3-b85dfcb403f4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:50.522118 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e13af958-4e4e-41bc-98f3-b85dfcb403f4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:50.529359 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e13af958-4e4e-41bc-98f3-b85dfcb403f4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147035 Jul 19 09:35:50.529919 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 628/1227] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:50 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:51.546187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8185203e-e3ef-45fd-8a7e-9feabfdcdcaf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:51.546807 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8185203e-e3ef-45fd-8a7e-9feabfdcdcaf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:51.552630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8185203e-e3ef-45fd-8a7e-9feabfdcdcaf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:51.553075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8185203e-e3ef-45fd-8a7e-9feabfdcdcaf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:51.553829 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8185203e-e3ef-45fd-8a7e-9feabfdcdcaf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:51.554257 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8185203e-e3ef-45fd-8a7e-9feabfdcdcaf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:51.684596 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8185203e-e3ef-45fd-8a7e-9feabfdcdcaf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:51.692366 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8185203e-e3ef-45fd-8a7e-9feabfdcdcaf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149908 Jul 19 09:35:51.692926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 600/1228] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:51 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:52.709037 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b369bdb0-e52b-42d7-986a-4a23aef923c6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:52.709651 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b369bdb0-e52b-42d7-986a-4a23aef923c6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:52.715725 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b369bdb0-e52b-42d7-986a-4a23aef923c6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:52.716184 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b369bdb0-e52b-42d7-986a-4a23aef923c6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:52.716953 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b369bdb0-e52b-42d7-986a-4a23aef923c6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:52.717390 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b369bdb0-e52b-42d7-986a-4a23aef923c6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:52.847368 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b369bdb0-e52b-42d7-986a-4a23aef923c6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:52.854999 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b369bdb0-e52b-42d7-986a-4a23aef923c6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149704 Jul 19 09:35:52.855590 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 629/1229] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:52 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:53.871094 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c54ea6c8-247e-41a2-8866-26c28132b091 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:53.871705 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c54ea6c8-247e-41a2-8866-26c28132b091 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:53.878110 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c54ea6c8-247e-41a2-8866-26c28132b091 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:53.878561 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c54ea6c8-247e-41a2-8866-26c28132b091 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:53.879387 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c54ea6c8-247e-41a2-8866-26c28132b091 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:53.879819 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c54ea6c8-247e-41a2-8866-26c28132b091 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:54.014386 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c54ea6c8-247e-41a2-8866-26c28132b091 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:54.021604 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c54ea6c8-247e-41a2-8866-26c28132b091 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.154157 Jul 19 09:35:54.022168 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 601/1230] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:53 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:55.038862 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f6334183-83fb-44e5-adc0-6f8e91fe9050 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:55.039493 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f6334183-83fb-44e5-adc0-6f8e91fe9050 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:55.045079 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6334183-83fb-44e5-adc0-6f8e91fe9050 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:55.045523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6334183-83fb-44e5-adc0-6f8e91fe9050 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:55.046917 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6334183-83fb-44e5-adc0-6f8e91fe9050 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:55.047379 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f6334183-83fb-44e5-adc0-6f8e91fe9050 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:55.181574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f6334183-83fb-44e5-adc0-6f8e91fe9050 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:55.188722 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f6334183-83fb-44e5-adc0-6f8e91fe9050 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.153714 Jul 19 09:35:55.189290 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 630/1231] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:55 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:56.204805 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-29bd57ef-e6b8-4e1e-9b5c-374aa7061041 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:56.205420 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-29bd57ef-e6b8-4e1e-9b5c-374aa7061041 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:56.211254 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-29bd57ef-e6b8-4e1e-9b5c-374aa7061041 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:56.211708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-29bd57ef-e6b8-4e1e-9b5c-374aa7061041 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:56.212467 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-29bd57ef-e6b8-4e1e-9b5c-374aa7061041 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:56.212900 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-29bd57ef-e6b8-4e1e-9b5c-374aa7061041 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:56.344701 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-29bd57ef-e6b8-4e1e-9b5c-374aa7061041 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:56.352353 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-29bd57ef-e6b8-4e1e-9b5c-374aa7061041 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151325 Jul 19 09:35:56.352917 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 602/1232] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:56 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:57.369897 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e44d44c4-995d-402d-a74f-b8d92e68d412 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:57.370433 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e44d44c4-995d-402d-a74f-b8d92e68d412 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:57.376208 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e44d44c4-995d-402d-a74f-b8d92e68d412 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:57.376654 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e44d44c4-995d-402d-a74f-b8d92e68d412 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:57.378054 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e44d44c4-995d-402d-a74f-b8d92e68d412 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:57.378505 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e44d44c4-995d-402d-a74f-b8d92e68d412 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:57.509316 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e44d44c4-995d-402d-a74f-b8d92e68d412 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:57.516724 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e44d44c4-995d-402d-a74f-b8d92e68d412 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150465 Jul 19 09:35:57.517546 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 631/1233] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:57 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:35:58.533451 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a0e3abff-8c81-4b5d-95bf-ad21f8b67c1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:58.534189 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a0e3abff-8c81-4b5d-95bf-ad21f8b67c1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:58.540086 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a0e3abff-8c81-4b5d-95bf-ad21f8b67c1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:58.540530 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a0e3abff-8c81-4b5d-95bf-ad21f8b67c1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:58.541287 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a0e3abff-8c81-4b5d-95bf-ad21f8b67c1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:58.541717 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a0e3abff-8c81-4b5d-95bf-ad21f8b67c1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:58.673569 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a0e3abff-8c81-4b5d-95bf-ad21f8b67c1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:58.680927 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a0e3abff-8c81-4b5d-95bf-ad21f8b67c1e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151242 Jul 19 09:35:58.681482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 603/1234] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:58 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:35:59.697688 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5ccf9b8a-7d2f-48e8-8477-ebde8d2d3be6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:35:59.698399 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5ccf9b8a-7d2f-48e8-8477-ebde8d2d3be6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:35:59.704470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5ccf9b8a-7d2f-48e8-8477-ebde8d2d3be6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:59.704919 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5ccf9b8a-7d2f-48e8-8477-ebde8d2d3be6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:59.705676 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5ccf9b8a-7d2f-48e8-8477-ebde8d2d3be6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:35:59.706138 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5ccf9b8a-7d2f-48e8-8477-ebde8d2d3be6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:35:59.837806 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5ccf9b8a-7d2f-48e8-8477-ebde8d2d3be6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:35:59.845598 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5ccf9b8a-7d2f-48e8-8477-ebde8d2d3be6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151610 Jul 19 09:35:59.846160 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 632/1235] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:35:59 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:00.862106 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-66e1510f-c26b-481f-a8eb-7f105b52b07c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:00.862715 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-66e1510f-c26b-481f-a8eb-7f105b52b07c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:00.868490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-66e1510f-c26b-481f-a8eb-7f105b52b07c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:00.868939 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-66e1510f-c26b-481f-a8eb-7f105b52b07c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:00.869763 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-66e1510f-c26b-481f-a8eb-7f105b52b07c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:00.870197 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-66e1510f-c26b-481f-a8eb-7f105b52b07c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:01.002248 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-66e1510f-c26b-481f-a8eb-7f105b52b07c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:01.009507 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-66e1510f-c26b-481f-a8eb-7f105b52b07c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151693 Jul 19 09:36:01.010069 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 604/1236] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:00 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:02.027125 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8570ef56-071d-4212-b5c5-e082d08f9142 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:02.027639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8570ef56-071d-4212-b5c5-e082d08f9142 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:02.033381 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8570ef56-071d-4212-b5c5-e082d08f9142 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:02.033829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8570ef56-071d-4212-b5c5-e082d08f9142 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:02.034589 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8570ef56-071d-4212-b5c5-e082d08f9142 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:02.035020 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8570ef56-071d-4212-b5c5-e082d08f9142 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:02.164952 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8570ef56-071d-4212-b5c5-e082d08f9142 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:02.172998 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8570ef56-071d-4212-b5c5-e082d08f9142 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149563 Jul 19 09:36:02.173573 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 633/1237] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:02 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:03.190220 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bc36510e-783b-417a-b3d9-dd6edfdb8c8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:03.190826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bc36510e-783b-417a-b3d9-dd6edfdb8c8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:03.196750 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc36510e-783b-417a-b3d9-dd6edfdb8c8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:03.197198 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc36510e-783b-417a-b3d9-dd6edfdb8c8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:03.197961 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc36510e-783b-417a-b3d9-dd6edfdb8c8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:03.198395 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc36510e-783b-417a-b3d9-dd6edfdb8c8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:03.329879 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bc36510e-783b-417a-b3d9-dd6edfdb8c8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:03.337100 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bc36510e-783b-417a-b3d9-dd6edfdb8c8b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151060 Jul 19 09:36:03.337666 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 605/1238] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:03 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:04.353347 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e9aa2eb0-8cf9-4de3-9071-a3d160679c01 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:04.353960 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e9aa2eb0-8cf9-4de3-9071-a3d160679c01 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:04.360003 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9aa2eb0-8cf9-4de3-9071-a3d160679c01 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:04.360462 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9aa2eb0-8cf9-4de3-9071-a3d160679c01 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:04.361232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9aa2eb0-8cf9-4de3-9071-a3d160679c01 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:04.361668 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e9aa2eb0-8cf9-4de3-9071-a3d160679c01 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:04.489962 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e9aa2eb0-8cf9-4de3-9071-a3d160679c01 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:04.497292 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e9aa2eb0-8cf9-4de3-9071-a3d160679c01 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147571 Jul 19 09:36:04.497860 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 634/1239] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:04 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:05.514638 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-00ec6b16-1413-40a8-bb60-b226da19a49b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:05.516415 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-00ec6b16-1413-40a8-bb60-b226da19a49b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:05.521578 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-00ec6b16-1413-40a8-bb60-b226da19a49b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:05.522021 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-00ec6b16-1413-40a8-bb60-b226da19a49b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:05.522785 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-00ec6b16-1413-40a8-bb60-b226da19a49b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:05.523247 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-00ec6b16-1413-40a8-bb60-b226da19a49b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:05.654344 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-00ec6b16-1413-40a8-bb60-b226da19a49b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:05.662570 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-00ec6b16-1413-40a8-bb60-b226da19a49b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151474 Jul 19 09:36:05.663156 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 606/1240] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:05 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:36:06.678883 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5da1d222-7179-48f8-a333-ed1038cd1b15 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:06.679567 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5da1d222-7179-48f8-a333-ed1038cd1b15 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:06.685233 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5da1d222-7179-48f8-a333-ed1038cd1b15 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:06.685673 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5da1d222-7179-48f8-a333-ed1038cd1b15 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:06.686422 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5da1d222-7179-48f8-a333-ed1038cd1b15 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:06.686845 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5da1d222-7179-48f8-a333-ed1038cd1b15 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:06.819748 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5da1d222-7179-48f8-a333-ed1038cd1b15 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:06.826959 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5da1d222-7179-48f8-a333-ed1038cd1b15 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151660 Jul 19 09:36:06.827555 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 635/1241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:06 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:07.842976 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-aeea87d8-c34b-4502-baef-6f847e2120e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:07.843618 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-aeea87d8-c34b-4502-baef-6f847e2120e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:07.849255 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aeea87d8-c34b-4502-baef-6f847e2120e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:07.849706 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aeea87d8-c34b-4502-baef-6f847e2120e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:07.850472 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aeea87d8-c34b-4502-baef-6f847e2120e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:07.850913 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aeea87d8-c34b-4502-baef-6f847e2120e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:07.981974 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-aeea87d8-c34b-4502-baef-6f847e2120e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:07.989713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-aeea87d8-c34b-4502-baef-6f847e2120e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150319 Jul 19 09:36:07.990278 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 607/1242] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:07 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:09.006024 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ad43e9e0-e814-408d-ad69-b53ef7bb3a6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:09.006999 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ad43e9e0-e814-408d-ad69-b53ef7bb3a6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:09.012542 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ad43e9e0-e814-408d-ad69-b53ef7bb3a6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:09.012987 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ad43e9e0-e814-408d-ad69-b53ef7bb3a6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:09.013737 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ad43e9e0-e814-408d-ad69-b53ef7bb3a6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:09.014162 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ad43e9e0-e814-408d-ad69-b53ef7bb3a6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:09.145913 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ad43e9e0-e814-408d-ad69-b53ef7bb3a6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:09.153066 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ad43e9e0-e814-408d-ad69-b53ef7bb3a6e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.150807 Jul 19 09:36:09.153624 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 636/1243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:09 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:10.170585 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ae91b99c-6086-4507-b6f8-665b3146965f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:10.171343 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ae91b99c-6086-4507-b6f8-665b3146965f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:10.177515 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ae91b99c-6086-4507-b6f8-665b3146965f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:10.177966 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ae91b99c-6086-4507-b6f8-665b3146965f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:10.178728 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ae91b99c-6086-4507-b6f8-665b3146965f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:10.179205 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ae91b99c-6086-4507-b6f8-665b3146965f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:10.317424 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ae91b99c-6086-4507-b6f8-665b3146965f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:10.324657 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ae91b99c-6086-4507-b6f8-665b3146965f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.157934 Jul 19 09:36:10.325220 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 608/1244] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:10 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:11.340912 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9200b10d-ae2d-4807-9a74-303f159d4646 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:11.341516 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9200b10d-ae2d-4807-9a74-303f159d4646 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:11.347325 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9200b10d-ae2d-4807-9a74-303f159d4646 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:11.347785 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9200b10d-ae2d-4807-9a74-303f159d4646 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:11.348542 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9200b10d-ae2d-4807-9a74-303f159d4646 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:11.348999 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9200b10d-ae2d-4807-9a74-303f159d4646 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:11.481595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9200b10d-ae2d-4807-9a74-303f159d4646 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:11.488747 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9200b10d-ae2d-4807-9a74-303f159d4646 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.151603 Jul 19 09:36:11.489311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 637/1245] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:11 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:12.504942 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bd462f71-5fce-4c11-a31c-c0b97cd9b836 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:12.505548 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bd462f71-5fce-4c11-a31c-c0b97cd9b836 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:12.511264 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd462f71-5fce-4c11-a31c-c0b97cd9b836 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:12.511717 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd462f71-5fce-4c11-a31c-c0b97cd9b836 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:12.512487 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd462f71-5fce-4c11-a31c-c0b97cd9b836 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:12.512924 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd462f71-5fce-4c11-a31c-c0b97cd9b836 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:12.643064 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bd462f71-5fce-4c11-a31c-c0b97cd9b836 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:12.650342 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bd462f71-5fce-4c11-a31c-c0b97cd9b836 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.149673 Jul 19 09:36:12.650932 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 609/1246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:12 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:13.666928 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-91ca6514-1481-4530-ae02-2bc4fce23b14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:13.667558 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-91ca6514-1481-4530-ae02-2bc4fce23b14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:13.673897 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-91ca6514-1481-4530-ae02-2bc4fce23b14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:13.674343 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-91ca6514-1481-4530-ae02-2bc4fce23b14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:13.675127 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-91ca6514-1481-4530-ae02-2bc4fce23b14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:13.675560 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-91ca6514-1481-4530-ae02-2bc4fce23b14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:13.803832 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-91ca6514-1481-4530-ae02-2bc4fce23b14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:13.810956 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-91ca6514-1481-4530-ae02-2bc4fce23b14 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.147667 Jul 19 09:36:13.811558 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 638/1247] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:13 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:14.827856 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cf5d5184-2598-44a0-b018-af7587922292 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:14.828464 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cf5d5184-2598-44a0-b018-af7587922292 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:14.834391 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cf5d5184-2598-44a0-b018-af7587922292 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:14.835098 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cf5d5184-2598-44a0-b018-af7587922292 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:14.836114 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cf5d5184-2598-44a0-b018-af7587922292 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:14.836633 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cf5d5184-2598-44a0-b018-af7587922292 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:14.974860 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cf5d5184-2598-44a0-b018-af7587922292 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:14.982075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cf5d5184-2598-44a0-b018-af7587922292 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.158494 Jul 19 09:36:14.982859 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 610/1248] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:14 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:15.998481 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-27079b86-f76d-4aa8-9c93-8f6dea26f573 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:15.999119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-27079b86-f76d-4aa8-9c93-8f6dea26f573 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:16.005255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-27079b86-f76d-4aa8-9c93-8f6dea26f573 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:16.005709 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-27079b86-f76d-4aa8-9c93-8f6dea26f573 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:16.006493 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-27079b86-f76d-4aa8-9c93-8f6dea26f573 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:16.006925 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-27079b86-f76d-4aa8-9c93-8f6dea26f573 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:16.139583 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-27079b86-f76d-4aa8-9c93-8f6dea26f573 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:16.146993 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-27079b86-f76d-4aa8-9c93-8f6dea26f573 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152254 Jul 19 09:36:16.147585 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 639/1249] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:15 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:17.163881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5fd1e6b5-77e4-4101-8fec-12ce1f0b1d73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:17.164512 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5fd1e6b5-77e4-4101-8fec-12ce1f0b1d73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:17.170251 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5fd1e6b5-77e4-4101-8fec-12ce1f0b1d73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:17.170692 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5fd1e6b5-77e4-4101-8fec-12ce1f0b1d73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:17.171474 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5fd1e6b5-77e4-4101-8fec-12ce1f0b1d73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:17.171966 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5fd1e6b5-77e4-4101-8fec-12ce1f0b1d73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:17.305226 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5fd1e6b5-77e4-4101-8fec-12ce1f0b1d73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:17.312526 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5fd1e6b5-77e4-4101-8fec-12ce1f0b1d73 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1562 microversion: 2.1 time: 0.152508 Jul 19 09:36:17.313028 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 611/1250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:17 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:18.413889 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5d52af8c-2fb6-435a-b1bb-f14f6f82600e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:18.414369 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5d52af8c-2fb6-435a-b1bb-f14f6f82600e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:18.420644 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-0618fb08-110f-47db-8fde-59310f3f9769 req-f0f6bc3b-f8f2-49c9-8bd6-39c73d7e4b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee02e36e-7587-4ab3-b367-08e1c9b26c69", "tag": "8c6fc9b0-949b-4965-80e0-e84ca522d2a6"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:36:18.422696 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:36:18.422696 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:36:18.430544 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-0618fb08-110f-47db-8fde-59310f3f9769 req-f0f6bc3b-f8f2-49c9-8bd6-39c73d7e4b02 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:18.430964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5d52af8c-2fb6-435a-b1bb-f14f6f82600e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:18.431130 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-0618fb08-110f-47db-8fde-59310f3f9769 req-f0f6bc3b-f8f2-49c9-8bd6-39c73d7e4b02 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:18.431779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5d52af8c-2fb6-435a-b1bb-f14f6f82600e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:18.432771 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5d52af8c-2fb6-435a-b1bb-f14f6f82600e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:18.433608 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5d52af8c-2fb6-435a-b1bb-f14f6f82600e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:18.442569 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-0618fb08-110f-47db-8fde-59310f3f9769 req-f0f6bc3b-f8f2-49c9-8bd6-39c73d7e4b02 service nova] Creating event network-changed:8c6fc9b0-949b-4965-80e0-e84ca522d2a6 for instance ee02e36e-7587-4ab3-b367-08e1c9b26c69 on hv-cinder-79338 Jul 19 09:36:18.447753 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-0618fb08-110f-47db-8fde-59310f3f9769 req-f0f6bc3b-f8f2-49c9-8bd6-39c73d7e4b02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030602 Jul 19 09:36:18.448664 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 612/1251] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:36:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:36:18.464424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5d52af8c-2fb6-435a-b1bb-f14f6f82600e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Going to try to terminate instance {{(pid=107463) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:36:18.553783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5d52af8c-2fb6-435a-b1bb-f14f6f82600e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 204 len: 0 microversion: 2.1 time: 0.143457 Jul 19 09:36:18.566117 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b4eca02f-a377-48dd-8217-99675335d924 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:18.566939 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b4eca02f-a377-48dd-8217-99675335d924 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:18.570259 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 640/1252] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:36:18 2021] DELETE /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 09:36:18.573849 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b4eca02f-a377-48dd-8217-99675335d924 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:18.574419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b4eca02f-a377-48dd-8217-99675335d924 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:18.575330 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b4eca02f-a377-48dd-8217-99675335d924 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:18.575873 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b4eca02f-a377-48dd-8217-99675335d924 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:18.857273 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b4eca02f-a377-48dd-8217-99675335d924 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:18.866065 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b4eca02f-a377-48dd-8217-99675335d924 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1568 microversion: 2.1 time: 0.305762 Jul 19 09:36:18.872650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 613/1253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:18 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1568 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:19.884041 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c8591013-c822-486a-bfdd-10bcc07a0512 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:19.884641 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c8591013-c822-486a-bfdd-10bcc07a0512 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:19.890392 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c8591013-c822-486a-bfdd-10bcc07a0512 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:19.891367 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c8591013-c822-486a-bfdd-10bcc07a0512 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:19.892125 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c8591013-c822-486a-bfdd-10bcc07a0512 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:19.892554 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c8591013-c822-486a-bfdd-10bcc07a0512 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:19.955552 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c8591013-c822-486a-bfdd-10bcc07a0512 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:19.962612 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c8591013-c822-486a-bfdd-10bcc07a0512 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.082785 Jul 19 09:36:19.963200 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 641/1254] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:19 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:20.462503 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-fdd81d12-9f46-4366-8f1d-8d567504c254 req-f429a890-dd7a-46ca-8c10-93fb53f2b73e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee02e36e-7587-4ab3-b367-08e1c9b26c69", "name": "network-vif-deleted", "tag": "8c6fc9b0-949b-4965-80e0-e84ca522d2a6"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:36:20.464043 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:36:20.464043 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:36:20.470785 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-fdd81d12-9f46-4366-8f1d-8d567504c254 req-f429a890-dd7a-46ca-8c10-93fb53f2b73e service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:20.471280 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-fdd81d12-9f46-4366-8f1d-8d567504c254 req-f429a890-dd7a-46ca-8c10-93fb53f2b73e service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:20.481717 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-fdd81d12-9f46-4366-8f1d-8d567504c254 req-f429a890-dd7a-46ca-8c10-93fb53f2b73e service nova] Creating event network-vif-deleted:8c6fc9b0-949b-4965-80e0-e84ca522d2a6 for instance ee02e36e-7587-4ab3-b367-08e1c9b26c69 on hv-cinder-79338 Jul 19 09:36:20.486506 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-fdd81d12-9f46-4366-8f1d-8d567504c254 req-f429a890-dd7a-46ca-8c10-93fb53f2b73e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028079 Jul 19 09:36:20.487084 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 614/1255] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:36:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:36:20.979537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-82b8a043-3c04-4b38-a026-0c5db6347502 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:20.980143 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-82b8a043-3c04-4b38-a026-0c5db6347502 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:20.986550 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-82b8a043-3c04-4b38-a026-0c5db6347502 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:20.986994 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-82b8a043-3c04-4b38-a026-0c5db6347502 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:20.987771 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-82b8a043-3c04-4b38-a026-0c5db6347502 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:20.988204 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-82b8a043-3c04-4b38-a026-0c5db6347502 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:21.046533 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-82b8a043-3c04-4b38-a026-0c5db6347502 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:21.054184 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-82b8a043-3c04-4b38-a026-0c5db6347502 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078269 Jul 19 09:36:21.054739 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 642/1256] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:20 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:22.070952 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-32e8477b-f821-4ce3-99f1-280cd65eb4d9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:22.071677 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-32e8477b-f821-4ce3-99f1-280cd65eb4d9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:22.077691 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32e8477b-f821-4ce3-99f1-280cd65eb4d9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:22.078140 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32e8477b-f821-4ce3-99f1-280cd65eb4d9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:22.078901 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32e8477b-f821-4ce3-99f1-280cd65eb4d9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:22.079362 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32e8477b-f821-4ce3-99f1-280cd65eb4d9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:22.144284 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-32e8477b-f821-4ce3-99f1-280cd65eb4d9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:22.151537 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-32e8477b-f821-4ce3-99f1-280cd65eb4d9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.084588 Jul 19 09:36:22.152094 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 615/1257] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:22 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:23.167488 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-55e6baa7-44c3-4d86-8818-5d7c786d05e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:23.168081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-55e6baa7-44c3-4d86-8818-5d7c786d05e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:23.174492 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-55e6baa7-44c3-4d86-8818-5d7c786d05e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:23.175011 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-55e6baa7-44c3-4d86-8818-5d7c786d05e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:23.175790 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-55e6baa7-44c3-4d86-8818-5d7c786d05e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:23.176223 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-55e6baa7-44c3-4d86-8818-5d7c786d05e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:23.235155 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-55e6baa7-44c3-4d86-8818-5d7c786d05e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:23.242272 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-55e6baa7-44c3-4d86-8818-5d7c786d05e0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078625 Jul 19 09:36:23.242839 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 643/1258] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:23 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:24.258201 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-29f3979c-5549-4204-aff0-ba16995815ff tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:24.258811 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-29f3979c-5549-4204-aff0-ba16995815ff tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:24.264674 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-29f3979c-5549-4204-aff0-ba16995815ff tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:24.265119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-29f3979c-5549-4204-aff0-ba16995815ff tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:24.266443 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-29f3979c-5549-4204-aff0-ba16995815ff tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:24.266875 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-29f3979c-5549-4204-aff0-ba16995815ff tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:24.327348 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-29f3979c-5549-4204-aff0-ba16995815ff tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:24.334601 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-29f3979c-5549-4204-aff0-ba16995815ff tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.080070 Jul 19 09:36:24.335186 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 616/1259] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:24 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:25.350995 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0fbaf41c-0d51-45c6-a44e-fe3e3f2c8042 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:25.351625 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0fbaf41c-0d51-45c6-a44e-fe3e3f2c8042 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:25.357457 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0fbaf41c-0d51-45c6-a44e-fe3e3f2c8042 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:25.357901 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0fbaf41c-0d51-45c6-a44e-fe3e3f2c8042 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:25.358671 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0fbaf41c-0d51-45c6-a44e-fe3e3f2c8042 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:25.359669 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0fbaf41c-0d51-45c6-a44e-fe3e3f2c8042 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:25.418272 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0fbaf41c-0d51-45c6-a44e-fe3e3f2c8042 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:25.425850 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0fbaf41c-0d51-45c6-a44e-fe3e3f2c8042 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078495 Jul 19 09:36:25.426408 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 644/1260] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:25 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:26.441316 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-aa3e25fd-e0cb-4c0b-b856-dd5e3b911407 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:26.441896 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-aa3e25fd-e0cb-4c0b-b856-dd5e3b911407 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:26.448062 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aa3e25fd-e0cb-4c0b-b856-dd5e3b911407 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:26.448607 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aa3e25fd-e0cb-4c0b-b856-dd5e3b911407 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:26.449460 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aa3e25fd-e0cb-4c0b-b856-dd5e3b911407 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:26.450007 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aa3e25fd-e0cb-4c0b-b856-dd5e3b911407 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:26.511960 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-aa3e25fd-e0cb-4c0b-b856-dd5e3b911407 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:26.519525 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-aa3e25fd-e0cb-4c0b-b856-dd5e3b911407 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.082007 Jul 19 09:36:26.520084 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 617/1261] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:26 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:27.536709 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-626ee762-becd-400c-8503-d8cc5fd160a9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:27.537487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-626ee762-becd-400c-8503-d8cc5fd160a9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:27.543293 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-626ee762-becd-400c-8503-d8cc5fd160a9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:27.543770 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-626ee762-becd-400c-8503-d8cc5fd160a9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:27.545491 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-626ee762-becd-400c-8503-d8cc5fd160a9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:27.545922 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-626ee762-becd-400c-8503-d8cc5fd160a9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:27.608919 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-626ee762-becd-400c-8503-d8cc5fd160a9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:27.616081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-626ee762-becd-400c-8503-d8cc5fd160a9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.083133 Jul 19 09:36:27.616638 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 645/1262] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:27 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:28.633119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d091cab2-fbf0-4f8d-9656-6a66f2374a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:28.633665 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d091cab2-fbf0-4f8d-9656-6a66f2374a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:28.639463 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d091cab2-fbf0-4f8d-9656-6a66f2374a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:28.639909 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d091cab2-fbf0-4f8d-9656-6a66f2374a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:28.640673 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d091cab2-fbf0-4f8d-9656-6a66f2374a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:28.641109 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d091cab2-fbf0-4f8d-9656-6a66f2374a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:28.700325 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d091cab2-fbf0-4f8d-9656-6a66f2374a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:28.707351 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d091cab2-fbf0-4f8d-9656-6a66f2374a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078048 Jul 19 09:36:28.707915 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 618/1263] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:28 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:29.723282 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1871663f-254a-482e-ae59-999606859ff9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:29.723881 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1871663f-254a-482e-ae59-999606859ff9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:29.729603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1871663f-254a-482e-ae59-999606859ff9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:29.730047 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1871663f-254a-482e-ae59-999606859ff9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:29.730793 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1871663f-254a-482e-ae59-999606859ff9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:29.731244 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1871663f-254a-482e-ae59-999606859ff9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:29.790028 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1871663f-254a-482e-ae59-999606859ff9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:29.797489 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1871663f-254a-482e-ae59-999606859ff9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077876 Jul 19 09:36:29.798041 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 646/1264] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:29 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:30.814272 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8c320973-ec6e-4c1d-9c17-68b03cd98ae7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:30.814883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8c320973-ec6e-4c1d-9c17-68b03cd98ae7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:30.820908 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8c320973-ec6e-4c1d-9c17-68b03cd98ae7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:30.822219 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8c320973-ec6e-4c1d-9c17-68b03cd98ae7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:30.822997 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8c320973-ec6e-4c1d-9c17-68b03cd98ae7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:30.823515 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8c320973-ec6e-4c1d-9c17-68b03cd98ae7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:30.887846 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8c320973-ec6e-4c1d-9c17-68b03cd98ae7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:30.895698 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8c320973-ec6e-4c1d-9c17-68b03cd98ae7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.085574 Jul 19 09:36:30.896262 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 619/1265] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:30 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:31.912572 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c4a0c491-3846-4234-81e6-eb062f9eaa64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:31.913209 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c4a0c491-3846-4234-81e6-eb062f9eaa64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:31.919028 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c4a0c491-3846-4234-81e6-eb062f9eaa64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:31.919503 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c4a0c491-3846-4234-81e6-eb062f9eaa64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:31.920254 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c4a0c491-3846-4234-81e6-eb062f9eaa64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:31.920687 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c4a0c491-3846-4234-81e6-eb062f9eaa64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:31.979189 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c4a0c491-3846-4234-81e6-eb062f9eaa64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:31.986358 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c4a0c491-3846-4234-81e6-eb062f9eaa64 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077706 Jul 19 09:36:31.986917 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 647/1266] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:31 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:33.003334 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9050d168-c1ba-418f-a2d6-8c10434bf49d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:33.003940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9050d168-c1ba-418f-a2d6-8c10434bf49d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:33.009979 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9050d168-c1ba-418f-a2d6-8c10434bf49d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:33.010427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9050d168-c1ba-418f-a2d6-8c10434bf49d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:33.011228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9050d168-c1ba-418f-a2d6-8c10434bf49d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:33.011663 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9050d168-c1ba-418f-a2d6-8c10434bf49d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:33.071173 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9050d168-c1ba-418f-a2d6-8c10434bf49d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:33.078937 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9050d168-c1ba-418f-a2d6-8c10434bf49d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079226 Jul 19 09:36:33.079524 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 620/1267] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:32 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:34.095130 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e6b23af5-9dfd-464b-a7d8-1b245a7af9a0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:34.095716 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e6b23af5-9dfd-464b-a7d8-1b245a7af9a0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:34.101419 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e6b23af5-9dfd-464b-a7d8-1b245a7af9a0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:34.101865 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e6b23af5-9dfd-464b-a7d8-1b245a7af9a0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:34.102625 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e6b23af5-9dfd-464b-a7d8-1b245a7af9a0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:34.103075 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e6b23af5-9dfd-464b-a7d8-1b245a7af9a0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:34.161630 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e6b23af5-9dfd-464b-a7d8-1b245a7af9a0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:34.169198 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e6b23af5-9dfd-464b-a7d8-1b245a7af9a0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078273 Jul 19 09:36:34.169793 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 648/1268] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:34 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:35.185443 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cfcdd099-f4c7-452b-b5d2-ee812d2366ed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:35.186048 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cfcdd099-f4c7-452b-b5d2-ee812d2366ed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:35.192131 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cfcdd099-f4c7-452b-b5d2-ee812d2366ed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:35.192569 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cfcdd099-f4c7-452b-b5d2-ee812d2366ed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:35.193319 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cfcdd099-f4c7-452b-b5d2-ee812d2366ed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:35.193747 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cfcdd099-f4c7-452b-b5d2-ee812d2366ed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:35.253100 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cfcdd099-f4c7-452b-b5d2-ee812d2366ed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:35.260332 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cfcdd099-f4c7-452b-b5d2-ee812d2366ed tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078516 Jul 19 09:36:35.260889 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 621/1269] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:35 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:36.276800 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-430a3480-aa45-4bc5-97b3-cc601322bb79 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:36.277415 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-430a3480-aa45-4bc5-97b3-cc601322bb79 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:36.283212 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-430a3480-aa45-4bc5-97b3-cc601322bb79 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:36.283665 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-430a3480-aa45-4bc5-97b3-cc601322bb79 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:36.284422 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-430a3480-aa45-4bc5-97b3-cc601322bb79 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:36.284856 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-430a3480-aa45-4bc5-97b3-cc601322bb79 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:36.346308 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-430a3480-aa45-4bc5-97b3-cc601322bb79 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:36.353479 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-430a3480-aa45-4bc5-97b3-cc601322bb79 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.080346 Jul 19 09:36:36.354040 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 649/1270] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:36 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:37.371295 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5aaae93f-3ed7-4722-a411-0067894ca52c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:37.371896 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5aaae93f-3ed7-4722-a411-0067894ca52c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:37.378280 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5aaae93f-3ed7-4722-a411-0067894ca52c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:37.378723 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5aaae93f-3ed7-4722-a411-0067894ca52c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:37.379502 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5aaae93f-3ed7-4722-a411-0067894ca52c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:37.379932 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5aaae93f-3ed7-4722-a411-0067894ca52c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:37.440007 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5aaae93f-3ed7-4722-a411-0067894ca52c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:37.447097 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5aaae93f-3ed7-4722-a411-0067894ca52c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079438 Jul 19 09:36:37.447659 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 622/1271] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:37 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:38.464096 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-39b747c0-4814-42a0-9072-4af58bda399d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:38.464702 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-39b747c0-4814-42a0-9072-4af58bda399d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:38.470945 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39b747c0-4814-42a0-9072-4af58bda399d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:38.471460 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39b747c0-4814-42a0-9072-4af58bda399d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:38.472259 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39b747c0-4814-42a0-9072-4af58bda399d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:38.472693 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39b747c0-4814-42a0-9072-4af58bda399d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:38.531582 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-39b747c0-4814-42a0-9072-4af58bda399d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:38.538943 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-39b747c0-4814-42a0-9072-4af58bda399d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078506 Jul 19 09:36:38.539552 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 650/1272] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:38 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:39.554952 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2dc94941-ed72-4306-b13d-0197017c3633 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:39.555510 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2dc94941-ed72-4306-b13d-0197017c3633 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:39.561249 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2dc94941-ed72-4306-b13d-0197017c3633 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:39.561701 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2dc94941-ed72-4306-b13d-0197017c3633 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:39.562463 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2dc94941-ed72-4306-b13d-0197017c3633 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:39.562894 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2dc94941-ed72-4306-b13d-0197017c3633 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:39.627520 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2dc94941-ed72-4306-b13d-0197017c3633 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:39.634642 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2dc94941-ed72-4306-b13d-0197017c3633 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.083417 Jul 19 09:36:39.635228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 623/1273] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:39 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:40.651728 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2c5e5c53-144e-48cd-8084-e14fd6a5c8f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:40.652263 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2c5e5c53-144e-48cd-8084-e14fd6a5c8f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:40.658658 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2c5e5c53-144e-48cd-8084-e14fd6a5c8f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:40.659138 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2c5e5c53-144e-48cd-8084-e14fd6a5c8f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:40.659895 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2c5e5c53-144e-48cd-8084-e14fd6a5c8f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:40.660328 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2c5e5c53-144e-48cd-8084-e14fd6a5c8f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:40.719273 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2c5e5c53-144e-48cd-8084-e14fd6a5c8f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:40.726266 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2c5e5c53-144e-48cd-8084-e14fd6a5c8f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078310 Jul 19 09:36:40.726824 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 651/1274] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:40 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:41.742664 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-62979e1c-7de0-4860-8277-d805377f2ce6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:41.743308 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-62979e1c-7de0-4860-8277-d805377f2ce6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:41.749136 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-62979e1c-7de0-4860-8277-d805377f2ce6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:41.750155 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-62979e1c-7de0-4860-8277-d805377f2ce6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:41.750924 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-62979e1c-7de0-4860-8277-d805377f2ce6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:41.751392 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-62979e1c-7de0-4860-8277-d805377f2ce6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:41.810597 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-62979e1c-7de0-4860-8277-d805377f2ce6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:41.818489 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-62979e1c-7de0-4860-8277-d805377f2ce6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079455 Jul 19 09:36:41.819070 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 624/1275] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:41 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:42.834460 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8853a84f-6139-451a-a1ab-776875540ad8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:42.835087 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8853a84f-6139-451a-a1ab-776875540ad8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:42.840856 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8853a84f-6139-451a-a1ab-776875540ad8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:42.841312 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8853a84f-6139-451a-a1ab-776875540ad8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:42.842073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8853a84f-6139-451a-a1ab-776875540ad8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:42.842510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8853a84f-6139-451a-a1ab-776875540ad8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:42.900933 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8853a84f-6139-451a-a1ab-776875540ad8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:42.908037 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8853a84f-6139-451a-a1ab-776875540ad8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077227 Jul 19 09:36:42.908605 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 652/1276] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:42 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:43.924569 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f19ebf18-104a-4ba3-9bef-faef9a97753f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:43.925176 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f19ebf18-104a-4ba3-9bef-faef9a97753f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:43.930860 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f19ebf18-104a-4ba3-9bef-faef9a97753f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:43.931347 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f19ebf18-104a-4ba3-9bef-faef9a97753f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:43.932112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f19ebf18-104a-4ba3-9bef-faef9a97753f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:43.932545 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f19ebf18-104a-4ba3-9bef-faef9a97753f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:43.992700 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f19ebf18-104a-4ba3-9bef-faef9a97753f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:43.999913 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f19ebf18-104a-4ba3-9bef-faef9a97753f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079045 Jul 19 09:36:44.000472 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 625/1277] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:43 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:45.016152 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1cf56e0b-149c-42ca-a036-5997ab4639ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:45.016766 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1cf56e0b-149c-42ca-a036-5997ab4639ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:45.022559 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1cf56e0b-149c-42ca-a036-5997ab4639ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:45.023011 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1cf56e0b-149c-42ca-a036-5997ab4639ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:45.023798 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1cf56e0b-149c-42ca-a036-5997ab4639ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:45.024232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1cf56e0b-149c-42ca-a036-5997ab4639ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:45.085719 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1cf56e0b-149c-42ca-a036-5997ab4639ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:45.092831 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1cf56e0b-149c-42ca-a036-5997ab4639ec tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.080322 Jul 19 09:36:45.093988 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 653/1278] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:45 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:46.109925 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ac8741db-9d48-42aa-b251-e030f2e70ca7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:46.110531 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ac8741db-9d48-42aa-b251-e030f2e70ca7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:46.116277 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ac8741db-9d48-42aa-b251-e030f2e70ca7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:46.116727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ac8741db-9d48-42aa-b251-e030f2e70ca7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:46.117486 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ac8741db-9d48-42aa-b251-e030f2e70ca7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:46.117919 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ac8741db-9d48-42aa-b251-e030f2e70ca7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:46.177288 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ac8741db-9d48-42aa-b251-e030f2e70ca7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:46.184540 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ac8741db-9d48-42aa-b251-e030f2e70ca7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078754 Jul 19 09:36:46.185096 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 626/1279] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:46 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:47.201388 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7178a4e2-70f0-4e92-a16d-1978372d85f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:47.201984 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7178a4e2-70f0-4e92-a16d-1978372d85f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:47.208365 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7178a4e2-70f0-4e92-a16d-1978372d85f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:47.208808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7178a4e2-70f0-4e92-a16d-1978372d85f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:47.209555 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7178a4e2-70f0-4e92-a16d-1978372d85f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:47.209982 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7178a4e2-70f0-4e92-a16d-1978372d85f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:47.268957 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7178a4e2-70f0-4e92-a16d-1978372d85f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:47.276011 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7178a4e2-70f0-4e92-a16d-1978372d85f3 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078240 Jul 19 09:36:47.276570 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 654/1280] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:47 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:48.292584 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ef5e7eda-f167-4595-a6e1-f499ef577dd8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:48.293191 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ef5e7eda-f167-4595-a6e1-f499ef577dd8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:48.298973 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ef5e7eda-f167-4595-a6e1-f499ef577dd8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:48.299448 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ef5e7eda-f167-4595-a6e1-f499ef577dd8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:48.300211 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ef5e7eda-f167-4595-a6e1-f499ef577dd8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:48.300644 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ef5e7eda-f167-4595-a6e1-f499ef577dd8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:48.363024 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ef5e7eda-f167-4595-a6e1-f499ef577dd8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:48.370187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ef5e7eda-f167-4595-a6e1-f499ef577dd8 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.081346 Jul 19 09:36:48.370750 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 627/1281] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:48 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:49.386725 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6c8e6d28-0ebc-4a5e-ae24-addf562b2645 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:49.387364 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6c8e6d28-0ebc-4a5e-ae24-addf562b2645 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:49.393156 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c8e6d28-0ebc-4a5e-ae24-addf562b2645 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:49.393601 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c8e6d28-0ebc-4a5e-ae24-addf562b2645 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:49.394370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c8e6d28-0ebc-4a5e-ae24-addf562b2645 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:49.394775 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c8e6d28-0ebc-4a5e-ae24-addf562b2645 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:49.454590 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6c8e6d28-0ebc-4a5e-ae24-addf562b2645 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:49.461619 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6c8e6d28-0ebc-4a5e-ae24-addf562b2645 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078506 Jul 19 09:36:49.462177 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 655/1282] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:49 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:50.477792 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3f43d916-310f-4b3e-84af-9190600005b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:50.478338 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3f43d916-310f-4b3e-84af-9190600005b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:50.484119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3f43d916-310f-4b3e-84af-9190600005b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:50.484570 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3f43d916-310f-4b3e-84af-9190600005b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:50.485394 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3f43d916-310f-4b3e-84af-9190600005b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:50.485823 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3f43d916-310f-4b3e-84af-9190600005b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:50.546305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3f43d916-310f-4b3e-84af-9190600005b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:50.553468 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3f43d916-310f-4b3e-84af-9190600005b9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079353 Jul 19 09:36:50.554021 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 628/1283] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:50 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:51.569932 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bed7a358-82d1-44d9-a266-02f5548ae67f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:51.570658 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bed7a358-82d1-44d9-a266-02f5548ae67f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:51.576327 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bed7a358-82d1-44d9-a266-02f5548ae67f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:51.576772 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bed7a358-82d1-44d9-a266-02f5548ae67f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:51.577520 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bed7a358-82d1-44d9-a266-02f5548ae67f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:51.577952 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bed7a358-82d1-44d9-a266-02f5548ae67f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:51.636167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bed7a358-82d1-44d9-a266-02f5548ae67f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:51.643301 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bed7a358-82d1-44d9-a266-02f5548ae67f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077451 Jul 19 09:36:51.643859 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 656/1284] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:51 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:36:52.659513 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-97ac857a-6db1-4a1e-b2d9-645c22d6a843 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:52.660036 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-97ac857a-6db1-4a1e-b2d9-645c22d6a843 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:52.666042 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97ac857a-6db1-4a1e-b2d9-645c22d6a843 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:52.666515 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97ac857a-6db1-4a1e-b2d9-645c22d6a843 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:52.667297 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97ac857a-6db1-4a1e-b2d9-645c22d6a843 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:52.667732 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-97ac857a-6db1-4a1e-b2d9-645c22d6a843 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:52.727501 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-97ac857a-6db1-4a1e-b2d9-645c22d6a843 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:52.734646 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-97ac857a-6db1-4a1e-b2d9-645c22d6a843 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079437 Jul 19 09:36:52.735237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 629/1285] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:52 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:53.751204 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a15d8eff-1325-4690-ab76-c53db284d68b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:53.751840 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a15d8eff-1325-4690-ab76-c53db284d68b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:53.757613 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a15d8eff-1325-4690-ab76-c53db284d68b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:53.758054 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a15d8eff-1325-4690-ab76-c53db284d68b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:53.759093 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a15d8eff-1325-4690-ab76-c53db284d68b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:53.759523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a15d8eff-1325-4690-ab76-c53db284d68b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:53.821012 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a15d8eff-1325-4690-ab76-c53db284d68b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:53.829111 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a15d8eff-1325-4690-ab76-c53db284d68b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.082221 Jul 19 09:36:53.829664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 657/1286] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:53 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:54.845409 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-dbbe9aca-2dc4-4c8f-84a3-3f4965cedd7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:54.846020 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-dbbe9aca-2dc4-4c8f-84a3-3f4965cedd7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:54.851863 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dbbe9aca-2dc4-4c8f-84a3-3f4965cedd7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:54.852309 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dbbe9aca-2dc4-4c8f-84a3-3f4965cedd7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:54.853071 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dbbe9aca-2dc4-4c8f-84a3-3f4965cedd7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:54.853506 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dbbe9aca-2dc4-4c8f-84a3-3f4965cedd7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:54.913016 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-dbbe9aca-2dc4-4c8f-84a3-3f4965cedd7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:54.920060 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-dbbe9aca-2dc4-4c8f-84a3-3f4965cedd7c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078842 Jul 19 09:36:54.920621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 630/1287] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:54 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:55.172797 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:36:55.172948 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:36:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:36:55.937936 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6c5bd0a3-cad7-4d32-aba6-a4634399960b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:55.938546 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6c5bd0a3-cad7-4d32-aba6-a4634399960b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:55.944324 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c5bd0a3-cad7-4d32-aba6-a4634399960b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:55.944768 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c5bd0a3-cad7-4d32-aba6-a4634399960b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:55.945514 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c5bd0a3-cad7-4d32-aba6-a4634399960b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:55.945939 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c5bd0a3-cad7-4d32-aba6-a4634399960b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:56.004369 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6c5bd0a3-cad7-4d32-aba6-a4634399960b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:56.011374 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6c5bd0a3-cad7-4d32-aba6-a4634399960b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077730 Jul 19 09:36:56.011924 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 658/1288] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:55 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:57.027667 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9ad52dce-f821-457a-a891-27a4ef915757 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:57.028214 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9ad52dce-f821-457a-a891-27a4ef915757 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:57.034564 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ad52dce-f821-457a-a891-27a4ef915757 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:57.035003 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ad52dce-f821-457a-a891-27a4ef915757 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:57.035780 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ad52dce-f821-457a-a891-27a4ef915757 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:57.036208 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ad52dce-f821-457a-a891-27a4ef915757 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:57.100279 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9ad52dce-f821-457a-a891-27a4ef915757 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:57.107576 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9ad52dce-f821-457a-a891-27a4ef915757 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.083616 Jul 19 09:36:57.108155 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 631/1289] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:57 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:58.124460 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5278b509-d099-4e81-8b66-6e7e58a2f058 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:58.125675 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5278b509-d099-4e81-8b66-6e7e58a2f058 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:58.131552 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5278b509-d099-4e81-8b66-6e7e58a2f058 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:58.132006 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5278b509-d099-4e81-8b66-6e7e58a2f058 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:58.132771 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5278b509-d099-4e81-8b66-6e7e58a2f058 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:58.133204 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5278b509-d099-4e81-8b66-6e7e58a2f058 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:58.192476 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5278b509-d099-4e81-8b66-6e7e58a2f058 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:58.199720 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5278b509-d099-4e81-8b66-6e7e58a2f058 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078931 Jul 19 09:36:58.200282 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 659/1290] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:58 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:36:59.216020 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ca325f67-2de2-4283-930d-955032f99164 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:36:59.216660 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ca325f67-2de2-4283-930d-955032f99164 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:36:59.222453 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca325f67-2de2-4283-930d-955032f99164 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:59.222906 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca325f67-2de2-4283-930d-955032f99164 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:59.223769 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca325f67-2de2-4283-930d-955032f99164 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:36:59.224202 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca325f67-2de2-4283-930d-955032f99164 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:36:59.282967 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ca325f67-2de2-4283-930d-955032f99164 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:36:59.290392 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ca325f67-2de2-4283-930d-955032f99164 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078024 Jul 19 09:36:59.290940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 632/1291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:36:59 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:00.306584 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bca2a41a-429f-4bcd-afa7-830ce92b52a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:00.307236 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bca2a41a-429f-4bcd-afa7-830ce92b52a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:00.313053 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bca2a41a-429f-4bcd-afa7-830ce92b52a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:00.313493 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bca2a41a-429f-4bcd-afa7-830ce92b52a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:00.314244 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bca2a41a-429f-4bcd-afa7-830ce92b52a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:00.314669 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bca2a41a-429f-4bcd-afa7-830ce92b52a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:00.372896 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bca2a41a-429f-4bcd-afa7-830ce92b52a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:00.379909 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bca2a41a-429f-4bcd-afa7-830ce92b52a2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077016 Jul 19 09:37:00.380464 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 660/1292] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:00 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:01.396328 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ae2ac2df-6b6f-42dd-b317-99ddbcdcf6ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:01.396933 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ae2ac2df-6b6f-42dd-b317-99ddbcdcf6ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:01.402627 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ae2ac2df-6b6f-42dd-b317-99ddbcdcf6ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:01.403098 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ae2ac2df-6b6f-42dd-b317-99ddbcdcf6ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:01.403868 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ae2ac2df-6b6f-42dd-b317-99ddbcdcf6ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:01.404298 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ae2ac2df-6b6f-42dd-b317-99ddbcdcf6ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:01.463751 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ae2ac2df-6b6f-42dd-b317-99ddbcdcf6ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:01.471432 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ae2ac2df-6b6f-42dd-b317-99ddbcdcf6ce tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078803 Jul 19 09:37:01.471990 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 633/1293] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:01 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:02.488956 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a39059cb-ee1c-477c-a311-1c4abc332782 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:02.489490 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a39059cb-ee1c-477c-a311-1c4abc332782 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:02.495119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a39059cb-ee1c-477c-a311-1c4abc332782 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:02.495567 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a39059cb-ee1c-477c-a311-1c4abc332782 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:02.496313 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a39059cb-ee1c-477c-a311-1c4abc332782 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:02.496735 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a39059cb-ee1c-477c-a311-1c4abc332782 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:02.558296 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a39059cb-ee1c-477c-a311-1c4abc332782 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:02.566027 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a39059cb-ee1c-477c-a311-1c4abc332782 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.081100 Jul 19 09:37:02.566590 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 661/1294] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:02 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:03.582764 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ddedf30b-2d36-40b2-bc87-cccb1727414c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:03.583397 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ddedf30b-2d36-40b2-bc87-cccb1727414c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:03.589432 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ddedf30b-2d36-40b2-bc87-cccb1727414c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:03.589883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ddedf30b-2d36-40b2-bc87-cccb1727414c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:03.590682 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ddedf30b-2d36-40b2-bc87-cccb1727414c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:03.591152 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ddedf30b-2d36-40b2-bc87-cccb1727414c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:03.651614 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ddedf30b-2d36-40b2-bc87-cccb1727414c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:03.658829 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ddedf30b-2d36-40b2-bc87-cccb1727414c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079700 Jul 19 09:37:03.659417 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 634/1295] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:03 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:04.676206 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f4c49c4d-ac2a-40b6-b225-ba91c1ef3d68 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:04.676835 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f4c49c4d-ac2a-40b6-b225-ba91c1ef3d68 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:04.682657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4c49c4d-ac2a-40b6-b225-ba91c1ef3d68 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:04.683137 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4c49c4d-ac2a-40b6-b225-ba91c1ef3d68 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:04.683895 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4c49c4d-ac2a-40b6-b225-ba91c1ef3d68 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:04.684326 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4c49c4d-ac2a-40b6-b225-ba91c1ef3d68 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:04.742545 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f4c49c4d-ac2a-40b6-b225-ba91c1ef3d68 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:04.749564 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f4c49c4d-ac2a-40b6-b225-ba91c1ef3d68 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.076974 Jul 19 09:37:04.750123 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 662/1296] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:04 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:05.766109 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a3eb65fe-f910-4e02-a2ca-7b74b53c60b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:05.766720 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a3eb65fe-f910-4e02-a2ca-7b74b53c60b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:05.772796 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a3eb65fe-f910-4e02-a2ca-7b74b53c60b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:05.773245 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a3eb65fe-f910-4e02-a2ca-7b74b53c60b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:05.774005 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a3eb65fe-f910-4e02-a2ca-7b74b53c60b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:05.774461 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a3eb65fe-f910-4e02-a2ca-7b74b53c60b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:05.836566 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a3eb65fe-f910-4e02-a2ca-7b74b53c60b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:05.844227 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a3eb65fe-f910-4e02-a2ca-7b74b53c60b6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.081803 Jul 19 09:37:05.844787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 635/1297] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:05 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:06.860917 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-40c07601-5138-48c7-8abd-bbfa7034f1da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:06.861532 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-40c07601-5138-48c7-8abd-bbfa7034f1da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:06.867342 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40c07601-5138-48c7-8abd-bbfa7034f1da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:06.867794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40c07601-5138-48c7-8abd-bbfa7034f1da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:06.868585 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40c07601-5138-48c7-8abd-bbfa7034f1da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:06.869021 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-40c07601-5138-48c7-8abd-bbfa7034f1da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:06.927957 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-40c07601-5138-48c7-8abd-bbfa7034f1da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:06.935149 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-40c07601-5138-48c7-8abd-bbfa7034f1da tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078410 Jul 19 09:37:06.935712 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 663/1298] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:06 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:07.951111 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-acffbd2b-a8f3-42b5-a349-0d041d0b684e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:07.951723 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-acffbd2b-a8f3-42b5-a349-0d041d0b684e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:07.957484 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-acffbd2b-a8f3-42b5-a349-0d041d0b684e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:07.957932 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-acffbd2b-a8f3-42b5-a349-0d041d0b684e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:07.958696 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-acffbd2b-a8f3-42b5-a349-0d041d0b684e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:07.959162 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-acffbd2b-a8f3-42b5-a349-0d041d0b684e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:08.018806 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-acffbd2b-a8f3-42b5-a349-0d041d0b684e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:08.026147 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-acffbd2b-a8f3-42b5-a349-0d041d0b684e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078676 Jul 19 09:37:08.026704 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 636/1299] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:07 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:09.042440 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-186aabe1-ea7c-4f1d-a47a-3a59d5895834 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:09.043054 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-186aabe1-ea7c-4f1d-a47a-3a59d5895834 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:09.045403 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 09:37:09.049874 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-186aabe1-ea7c-4f1d-a47a-3a59d5895834 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:09.050316 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-186aabe1-ea7c-4f1d-a47a-3a59d5895834 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:09.051080 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-186aabe1-ea7c-4f1d-a47a-3a59d5895834 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:09.051524 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-186aabe1-ea7c-4f1d-a47a-3a59d5895834 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:09.109886 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-186aabe1-ea7c-4f1d-a47a-3a59d5895834 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:09.116835 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-186aabe1-ea7c-4f1d-a47a-3a59d5895834 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077996 Jul 19 09:37:09.117394 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 664/1300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:09 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:10.133719 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5e3e80e5-9c49-454f-a51f-0db18b6e9a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:10.134333 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5e3e80e5-9c49-454f-a51f-0db18b6e9a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:10.140879 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5e3e80e5-9c49-454f-a51f-0db18b6e9a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:10.141324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5e3e80e5-9c49-454f-a51f-0db18b6e9a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:10.142219 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5e3e80e5-9c49-454f-a51f-0db18b6e9a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:10.142651 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5e3e80e5-9c49-454f-a51f-0db18b6e9a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:10.202046 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5e3e80e5-9c49-454f-a51f-0db18b6e9a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:10.209662 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5e3e80e5-9c49-454f-a51f-0db18b6e9a3e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079670 Jul 19 09:37:10.210224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 637/1301] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:10 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:11.226597 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-39c78c50-3118-4730-84bb-21a888c8ccb2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:11.227235 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-39c78c50-3118-4730-84bb-21a888c8ccb2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:11.244895 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39c78c50-3118-4730-84bb-21a888c8ccb2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:11.245342 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39c78c50-3118-4730-84bb-21a888c8ccb2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:11.246104 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39c78c50-3118-4730-84bb-21a888c8ccb2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:11.246542 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-39c78c50-3118-4730-84bb-21a888c8ccb2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:11.251703 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56230. Jul 19 09:37:11.309389 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-39c78c50-3118-4730-84bb-21a888c8ccb2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:11.316586 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-39c78c50-3118-4730-84bb-21a888c8ccb2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.093616 Jul 19 09:37:11.317144 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 665/1302] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:11 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:12.394494 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5e0f3971-0549-4e8d-b4a2-f9986fdcc215 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:12.395140 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5e0f3971-0549-4e8d-b4a2-f9986fdcc215 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:12.400910 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5e0f3971-0549-4e8d-b4a2-f9986fdcc215 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:12.401376 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5e0f3971-0549-4e8d-b4a2-f9986fdcc215 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:12.402122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5e0f3971-0549-4e8d-b4a2-f9986fdcc215 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:12.402551 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5e0f3971-0549-4e8d-b4a2-f9986fdcc215 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:12.463593 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5e0f3971-0549-4e8d-b4a2-f9986fdcc215 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:12.471444 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5e0f3971-0549-4e8d-b4a2-f9986fdcc215 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.142137 Jul 19 09:37:12.472005 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 638/1303] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:12 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:12.822702 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:37:12.823308 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:37:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:37:13.487929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-35a0bea0-a63e-446f-8ab8-ca134ab8cdd2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:13.488467 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-35a0bea0-a63e-446f-8ab8-ca134ab8cdd2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:13.494353 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-35a0bea0-a63e-446f-8ab8-ca134ab8cdd2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:13.494803 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-35a0bea0-a63e-446f-8ab8-ca134ab8cdd2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:13.495601 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-35a0bea0-a63e-446f-8ab8-ca134ab8cdd2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:13.496038 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-35a0bea0-a63e-446f-8ab8-ca134ab8cdd2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:13.554821 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-35a0bea0-a63e-446f-8ab8-ca134ab8cdd2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:13.561844 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-35a0bea0-a63e-446f-8ab8-ca134ab8cdd2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077681 Jul 19 09:37:13.562890 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 666/1304] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:13 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:37:14.204747 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:37:14.205213 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:37:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:37:14.579128 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f92a54a0-b697-442c-95ac-bab1aca3a3b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:14.579677 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f92a54a0-b697-442c-95ac-bab1aca3a3b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:14.585512 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f92a54a0-b697-442c-95ac-bab1aca3a3b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:14.585958 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f92a54a0-b697-442c-95ac-bab1aca3a3b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:14.586722 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f92a54a0-b697-442c-95ac-bab1aca3a3b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:14.587189 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f92a54a0-b697-442c-95ac-bab1aca3a3b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:14.649081 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f92a54a0-b697-442c-95ac-bab1aca3a3b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:14.656193 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f92a54a0-b697-442c-95ac-bab1aca3a3b2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.080670 Jul 19 09:37:14.656744 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 639/1305] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:14 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:15.673571 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-62e28821-c075-47e0-a57c-0ab0ed7d3461 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:15.674171 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-62e28821-c075-47e0-a57c-0ab0ed7d3461 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:15.680072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62e28821-c075-47e0-a57c-0ab0ed7d3461 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:15.680515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62e28821-c075-47e0-a57c-0ab0ed7d3461 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:15.681265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62e28821-c075-47e0-a57c-0ab0ed7d3461 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:15.681689 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-62e28821-c075-47e0-a57c-0ab0ed7d3461 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:15.740637 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-62e28821-c075-47e0-a57c-0ab0ed7d3461 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:15.747643 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-62e28821-c075-47e0-a57c-0ab0ed7d3461 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078300 Jul 19 09:37:15.748193 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 667/1306] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:15 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:16.764443 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e5a55399-b635-4624-b060-b17c18110335 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:16.765002 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e5a55399-b635-4624-b060-b17c18110335 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:16.770690 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e5a55399-b635-4624-b060-b17c18110335 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:16.771170 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e5a55399-b635-4624-b060-b17c18110335 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:16.771928 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e5a55399-b635-4624-b060-b17c18110335 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:16.772355 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e5a55399-b635-4624-b060-b17c18110335 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:16.832145 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e5a55399-b635-4624-b060-b17c18110335 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:16.839477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e5a55399-b635-4624-b060-b17c18110335 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078685 Jul 19 09:37:16.840035 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 640/1307] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:16 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:17.184868 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:37:17.185274 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:37:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:37:17.855563 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4ba426a9-162c-4f81-9eb9-6b1ba6264a1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:17.856172 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4ba426a9-162c-4f81-9eb9-6b1ba6264a1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:17.862007 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4ba426a9-162c-4f81-9eb9-6b1ba6264a1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:17.862458 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4ba426a9-162c-4f81-9eb9-6b1ba6264a1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:17.863256 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4ba426a9-162c-4f81-9eb9-6b1ba6264a1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:17.863687 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4ba426a9-162c-4f81-9eb9-6b1ba6264a1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:17.922931 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4ba426a9-162c-4f81-9eb9-6b1ba6264a1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:17.931088 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4ba426a9-162c-4f81-9eb9-6b1ba6264a1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079154 Jul 19 09:37:17.931663 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 668/1308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:17 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:18.948061 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-61537abf-d6b3-4da5-af0d-0f49573f6e71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:18.948690 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-61537abf-d6b3-4da5-af0d-0f49573f6e71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:18.954687 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-61537abf-d6b3-4da5-af0d-0f49573f6e71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:18.955170 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-61537abf-d6b3-4da5-af0d-0f49573f6e71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:18.955928 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-61537abf-d6b3-4da5-af0d-0f49573f6e71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:18.956355 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-61537abf-d6b3-4da5-af0d-0f49573f6e71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:19.016513 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-61537abf-d6b3-4da5-af0d-0f49573f6e71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:19.023636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-61537abf-d6b3-4da5-af0d-0f49573f6e71 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079404 Jul 19 09:37:19.024192 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 641/1309] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:18 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:20.040468 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cf4f0040-f814-4292-84ca-be967233fe1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:20.041081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-cf4f0040-f814-4292-84ca-be967233fe1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:20.046933 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf4f0040-f814-4292-84ca-be967233fe1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:20.047421 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf4f0040-f814-4292-84ca-be967233fe1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:20.048185 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf4f0040-f814-4292-84ca-be967233fe1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:20.048622 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf4f0040-f814-4292-84ca-be967233fe1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:20.109868 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cf4f0040-f814-4292-84ca-be967233fe1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:20.117712 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-cf4f0040-f814-4292-84ca-be967233fe1a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.081165 Jul 19 09:37:20.118273 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 669/1310] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:20 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:21.134619 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4da106b1-58e5-4e46-be1b-48bbeda85c61 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:21.135313 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4da106b1-58e5-4e46-be1b-48bbeda85c61 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:21.141334 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4da106b1-58e5-4e46-be1b-48bbeda85c61 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:21.141982 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4da106b1-58e5-4e46-be1b-48bbeda85c61 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:21.142845 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4da106b1-58e5-4e46-be1b-48bbeda85c61 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:21.143306 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4da106b1-58e5-4e46-be1b-48bbeda85c61 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:21.204468 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4da106b1-58e5-4e46-be1b-48bbeda85c61 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:21.211809 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4da106b1-58e5-4e46-be1b-48bbeda85c61 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.080839 Jul 19 09:37:21.212369 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 642/1311] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:21 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:22.228764 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e596f1e7-46bf-4763-8cc4-0f209532004a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:22.229359 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e596f1e7-46bf-4763-8cc4-0f209532004a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:22.235647 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e596f1e7-46bf-4763-8cc4-0f209532004a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:22.236088 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e596f1e7-46bf-4763-8cc4-0f209532004a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:22.236840 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e596f1e7-46bf-4763-8cc4-0f209532004a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:22.237265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e596f1e7-46bf-4763-8cc4-0f209532004a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:22.295918 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e596f1e7-46bf-4763-8cc4-0f209532004a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:22.303487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e596f1e7-46bf-4763-8cc4-0f209532004a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078323 Jul 19 09:37:22.304033 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 670/1312] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:22 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:23.320111 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bc891dd8-e2a5-44f5-94fe-97008d358c4b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:23.320649 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bc891dd8-e2a5-44f5-94fe-97008d358c4b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:23.326378 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc891dd8-e2a5-44f5-94fe-97008d358c4b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:23.326815 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc891dd8-e2a5-44f5-94fe-97008d358c4b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:23.327602 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc891dd8-e2a5-44f5-94fe-97008d358c4b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:23.328031 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bc891dd8-e2a5-44f5-94fe-97008d358c4b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:23.389896 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bc891dd8-e2a5-44f5-94fe-97008d358c4b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:23.397554 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bc891dd8-e2a5-44f5-94fe-97008d358c4b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.081201 Jul 19 09:37:23.398110 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 643/1313] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:23 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:24.414031 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8cceed11-4582-49de-ba3e-f81ef410ba75 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:24.414631 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8cceed11-4582-49de-ba3e-f81ef410ba75 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:24.420501 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8cceed11-4582-49de-ba3e-f81ef410ba75 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:24.420883 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8cceed11-4582-49de-ba3e-f81ef410ba75 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:24.421628 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8cceed11-4582-49de-ba3e-f81ef410ba75 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:24.422072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8cceed11-4582-49de-ba3e-f81ef410ba75 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:24.480759 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8cceed11-4582-49de-ba3e-f81ef410ba75 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:24.487788 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8cceed11-4582-49de-ba3e-f81ef410ba75 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077688 Jul 19 09:37:24.488338 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 671/1314] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:24 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:25.504245 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b45d355f-8670-42c2-a711-ad28bbfad886 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:25.504793 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b45d355f-8670-42c2-a711-ad28bbfad886 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:25.510518 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b45d355f-8670-42c2-a711-ad28bbfad886 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:25.510964 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b45d355f-8670-42c2-a711-ad28bbfad886 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:25.511960 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b45d355f-8670-42c2-a711-ad28bbfad886 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:25.512408 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b45d355f-8670-42c2-a711-ad28bbfad886 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:25.571866 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b45d355f-8670-42c2-a711-ad28bbfad886 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:25.578942 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b45d355f-8670-42c2-a711-ad28bbfad886 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078473 Jul 19 09:37:25.579524 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 644/1315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:25 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:26.595446 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bd21e193-eeef-4076-a291-f2c6c64b95fd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:26.595979 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bd21e193-eeef-4076-a291-f2c6c64b95fd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:26.601890 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bd21e193-eeef-4076-a291-f2c6c64b95fd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:26.602343 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bd21e193-eeef-4076-a291-f2c6c64b95fd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:26.603136 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bd21e193-eeef-4076-a291-f2c6c64b95fd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:26.603578 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bd21e193-eeef-4076-a291-f2c6c64b95fd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:26.662803 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bd21e193-eeef-4076-a291-f2c6c64b95fd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:26.669966 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bd21e193-eeef-4076-a291-f2c6c64b95fd tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078333 Jul 19 09:37:26.670527 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 672/1316] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:26 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:27.686850 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-50ab8041-a65d-47aa-a9b2-cba3140d0235 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:27.687514 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-50ab8041-a65d-47aa-a9b2-cba3140d0235 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:27.693864 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50ab8041-a65d-47aa-a9b2-cba3140d0235 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:27.694318 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50ab8041-a65d-47aa-a9b2-cba3140d0235 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:27.695101 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50ab8041-a65d-47aa-a9b2-cba3140d0235 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:27.695535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50ab8041-a65d-47aa-a9b2-cba3140d0235 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:27.754206 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-50ab8041-a65d-47aa-a9b2-cba3140d0235 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:27.761230 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-50ab8041-a65d-47aa-a9b2-cba3140d0235 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078057 Jul 19 09:37:27.761787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 645/1317] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:27 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:28.778182 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-fee232ed-453d-4343-abd3-d37cdbe47f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:28.778787 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-fee232ed-453d-4343-abd3-d37cdbe47f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:28.785227 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fee232ed-453d-4343-abd3-d37cdbe47f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:28.785672 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fee232ed-453d-4343-abd3-d37cdbe47f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:28.786687 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fee232ed-453d-4343-abd3-d37cdbe47f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:28.787189 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fee232ed-453d-4343-abd3-d37cdbe47f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:28.848128 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-fee232ed-453d-4343-abd3-d37cdbe47f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:28.855196 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-fee232ed-453d-4343-abd3-d37cdbe47f4a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.080649 Jul 19 09:37:28.855759 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 673/1318] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:28 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:29.871571 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ba292484-ea32-4d4d-90f8-674979193668 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:29.872174 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ba292484-ea32-4d4d-90f8-674979193668 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:29.878418 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba292484-ea32-4d4d-90f8-674979193668 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:29.878864 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba292484-ea32-4d4d-90f8-674979193668 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:29.879716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba292484-ea32-4d4d-90f8-674979193668 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:29.880153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba292484-ea32-4d4d-90f8-674979193668 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:29.938520 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ba292484-ea32-4d4d-90f8-674979193668 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:29.946118 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ba292484-ea32-4d4d-90f8-674979193668 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078222 Jul 19 09:37:29.946677 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 646/1319] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:29 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:30.963111 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7e92628f-9f3d-4cc1-8559-a688534979eb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:30.963724 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7e92628f-9f3d-4cc1-8559-a688534979eb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:30.969515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7e92628f-9f3d-4cc1-8559-a688534979eb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:30.969960 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7e92628f-9f3d-4cc1-8559-a688534979eb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:30.971311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7e92628f-9f3d-4cc1-8559-a688534979eb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:30.971761 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7e92628f-9f3d-4cc1-8559-a688534979eb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:31.029872 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7e92628f-9f3d-4cc1-8559-a688534979eb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:31.037813 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7e92628f-9f3d-4cc1-8559-a688534979eb tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078373 Jul 19 09:37:31.038399 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 674/1320] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:30 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:32.054385 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-49334817-556e-4aa0-b8ec-a6c48c824f3b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:32.055025 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-49334817-556e-4aa0-b8ec-a6c48c824f3b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:32.060799 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-49334817-556e-4aa0-b8ec-a6c48c824f3b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:32.061253 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-49334817-556e-4aa0-b8ec-a6c48c824f3b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:32.062009 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-49334817-556e-4aa0-b8ec-a6c48c824f3b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:32.062447 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-49334817-556e-4aa0-b8ec-a6c48c824f3b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:32.127426 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-49334817-556e-4aa0-b8ec-a6c48c824f3b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:32.134595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-49334817-556e-4aa0-b8ec-a6c48c824f3b tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.083904 Jul 19 09:37:32.135179 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 647/1321] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:32 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:33.199775 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ed75ba20-7622-4e75-8dc3-91abc11dddf0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:33.200382 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ed75ba20-7622-4e75-8dc3-91abc11dddf0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:33.206153 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ed75ba20-7622-4e75-8dc3-91abc11dddf0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:33.206599 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ed75ba20-7622-4e75-8dc3-91abc11dddf0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:33.207380 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ed75ba20-7622-4e75-8dc3-91abc11dddf0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:33.207813 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ed75ba20-7622-4e75-8dc3-91abc11dddf0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:33.266397 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ed75ba20-7622-4e75-8dc3-91abc11dddf0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:33.273566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ed75ba20-7622-4e75-8dc3-91abc11dddf0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077422 Jul 19 09:37:33.274125 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 675/1322] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:33 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:34.290217 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-386203f2-229a-4eb3-bb9a-4b40855f3a7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:34.290825 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-386203f2-229a-4eb3-bb9a-4b40855f3a7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:34.296653 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-386203f2-229a-4eb3-bb9a-4b40855f3a7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:34.297092 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-386203f2-229a-4eb3-bb9a-4b40855f3a7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:34.297847 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-386203f2-229a-4eb3-bb9a-4b40855f3a7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:34.298277 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-386203f2-229a-4eb3-bb9a-4b40855f3a7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:34.357637 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-386203f2-229a-4eb3-bb9a-4b40855f3a7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:34.365549 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-386203f2-229a-4eb3-bb9a-4b40855f3a7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079276 Jul 19 09:37:34.366115 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 648/1323] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:34 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:35.382396 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-57df85d3-ba6e-4a22-b699-96d286bb160f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:35.382996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-57df85d3-ba6e-4a22-b699-96d286bb160f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:35.388805 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-57df85d3-ba6e-4a22-b699-96d286bb160f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:35.389252 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-57df85d3-ba6e-4a22-b699-96d286bb160f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:35.390007 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-57df85d3-ba6e-4a22-b699-96d286bb160f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:35.390437 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-57df85d3-ba6e-4a22-b699-96d286bb160f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:35.449577 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-57df85d3-ba6e-4a22-b699-96d286bb160f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:35.456692 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-57df85d3-ba6e-4a22-b699-96d286bb160f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077980 Jul 19 09:37:35.457246 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 676/1324] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:35 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:36.473590 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a255d8f6-a425-4aeb-8f03-e51f40e8c9c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:36.474190 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a255d8f6-a425-4aeb-8f03-e51f40e8c9c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:36.479925 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a255d8f6-a425-4aeb-8f03-e51f40e8c9c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:36.480361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a255d8f6-a425-4aeb-8f03-e51f40e8c9c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:36.481107 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a255d8f6-a425-4aeb-8f03-e51f40e8c9c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:36.481532 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a255d8f6-a425-4aeb-8f03-e51f40e8c9c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:36.540806 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a255d8f6-a425-4aeb-8f03-e51f40e8c9c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:36.547890 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a255d8f6-a425-4aeb-8f03-e51f40e8c9c0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078512 Jul 19 09:37:36.548446 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 649/1325] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:36 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:37:37.564197 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b9b5c0e1-0337-4073-a243-a18a8a3785d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:37.564711 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b9b5c0e1-0337-4073-a243-a18a8a3785d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:37.570464 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9b5c0e1-0337-4073-a243-a18a8a3785d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:37.570909 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9b5c0e1-0337-4073-a243-a18a8a3785d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:37.571690 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9b5c0e1-0337-4073-a243-a18a8a3785d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:37.572121 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9b5c0e1-0337-4073-a243-a18a8a3785d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:37.633056 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b9b5c0e1-0337-4073-a243-a18a8a3785d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:37.640265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b9b5c0e1-0337-4073-a243-a18a8a3785d6 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079785 Jul 19 09:37:37.640814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 677/1326] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:37 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:38.656673 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b3388e4c-0a40-41c2-b39e-b6543760c081 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:38.657207 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b3388e4c-0a40-41c2-b39e-b6543760c081 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:38.663243 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b3388e4c-0a40-41c2-b39e-b6543760c081 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:38.663684 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b3388e4c-0a40-41c2-b39e-b6543760c081 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:38.664433 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b3388e4c-0a40-41c2-b39e-b6543760c081 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:38.664859 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b3388e4c-0a40-41c2-b39e-b6543760c081 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:38.723314 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b3388e4c-0a40-41c2-b39e-b6543760c081 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:38.730283 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b3388e4c-0a40-41c2-b39e-b6543760c081 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077325 Jul 19 09:37:38.730835 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 650/1327] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:38 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:39.747257 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bbc05bc5-8fd1-4b86-87c9-7bfb5cc4465e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:39.747797 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bbc05bc5-8fd1-4b86-87c9-7bfb5cc4465e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:39.753508 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbc05bc5-8fd1-4b86-87c9-7bfb5cc4465e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:39.753983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbc05bc5-8fd1-4b86-87c9-7bfb5cc4465e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:39.754747 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbc05bc5-8fd1-4b86-87c9-7bfb5cc4465e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:39.755214 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbc05bc5-8fd1-4b86-87c9-7bfb5cc4465e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:39.814336 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bbc05bc5-8fd1-4b86-87c9-7bfb5cc4465e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:39.821399 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bbc05bc5-8fd1-4b86-87c9-7bfb5cc4465e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077878 Jul 19 09:37:39.822004 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 678/1328] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:39 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:40.837626 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f705a051-7783-414a-86a6-63ada82593e7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:40.838259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f705a051-7783-414a-86a6-63ada82593e7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:40.844096 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f705a051-7783-414a-86a6-63ada82593e7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:40.844543 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f705a051-7783-414a-86a6-63ada82593e7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:40.845319 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f705a051-7783-414a-86a6-63ada82593e7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:40.845738 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f705a051-7783-414a-86a6-63ada82593e7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:40.904586 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f705a051-7783-414a-86a6-63ada82593e7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:40.912369 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f705a051-7783-414a-86a6-63ada82593e7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078407 Jul 19 09:37:40.912931 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 651/1329] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:40 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:41.929307 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2d2c6002-d653-4ad2-9511-b8f3f6ebf5f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:41.929881 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2d2c6002-d653-4ad2-9511-b8f3f6ebf5f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:41.935558 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2d2c6002-d653-4ad2-9511-b8f3f6ebf5f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:41.936004 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2d2c6002-d653-4ad2-9511-b8f3f6ebf5f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:41.936744 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2d2c6002-d653-4ad2-9511-b8f3f6ebf5f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:41.937168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2d2c6002-d653-4ad2-9511-b8f3f6ebf5f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:41.996583 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2d2c6002-d653-4ad2-9511-b8f3f6ebf5f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:42.004239 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2d2c6002-d653-4ad2-9511-b8f3f6ebf5f1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078719 Jul 19 09:37:42.004788 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 679/1330] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:41 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:43.021674 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-12c52c6b-b9a6-458a-b4b7-13e7dc15a1c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:43.022272 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-12c52c6b-b9a6-458a-b4b7-13e7dc15a1c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:43.028017 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12c52c6b-b9a6-458a-b4b7-13e7dc15a1c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:43.028457 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12c52c6b-b9a6-458a-b4b7-13e7dc15a1c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:43.029209 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12c52c6b-b9a6-458a-b4b7-13e7dc15a1c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:43.029640 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-12c52c6b-b9a6-458a-b4b7-13e7dc15a1c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:43.093281 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-12c52c6b-b9a6-458a-b4b7-13e7dc15a1c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:43.100514 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-12c52c6b-b9a6-458a-b4b7-13e7dc15a1c4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.083247 Jul 19 09:37:43.101074 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 652/1331] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:43 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:44.116923 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d744286d-707c-423b-b458-c6dfe69b9b09 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:44.117596 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d744286d-707c-423b-b458-c6dfe69b9b09 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:44.123296 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d744286d-707c-423b-b458-c6dfe69b9b09 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:44.123750 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d744286d-707c-423b-b458-c6dfe69b9b09 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:44.124513 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d744286d-707c-423b-b458-c6dfe69b9b09 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:44.124966 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d744286d-707c-423b-b458-c6dfe69b9b09 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:44.184238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d744286d-707c-423b-b458-c6dfe69b9b09 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:44.191380 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d744286d-707c-423b-b458-c6dfe69b9b09 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078124 Jul 19 09:37:44.191939 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 680/1332] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:44 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:45.207627 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b18527b8-b141-4b05-8af0-881a259fa5c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:45.208276 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b18527b8-b141-4b05-8af0-881a259fa5c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:45.214006 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b18527b8-b141-4b05-8af0-881a259fa5c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:45.214446 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b18527b8-b141-4b05-8af0-881a259fa5c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:45.215238 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b18527b8-b141-4b05-8af0-881a259fa5c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:45.215666 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b18527b8-b141-4b05-8af0-881a259fa5c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:45.274575 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b18527b8-b141-4b05-8af0-881a259fa5c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:45.281584 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b18527b8-b141-4b05-8af0-881a259fa5c1 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077585 Jul 19 09:37:45.282137 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 653/1333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:45 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:46.298681 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cb81a797-2b9a-41cc-8e0f-a9720b97f237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:46.299803 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-cb81a797-2b9a-41cc-8e0f-a9720b97f237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:46.305607 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cb81a797-2b9a-41cc-8e0f-a9720b97f237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:46.306055 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cb81a797-2b9a-41cc-8e0f-a9720b97f237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:46.306808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cb81a797-2b9a-41cc-8e0f-a9720b97f237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:46.307280 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cb81a797-2b9a-41cc-8e0f-a9720b97f237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:46.371076 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cb81a797-2b9a-41cc-8e0f-a9720b97f237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:46.378809 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-cb81a797-2b9a-41cc-8e0f-a9720b97f237 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.083797 Jul 19 09:37:46.379396 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 681/1334] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:46 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:47.395849 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6e20850c-7d73-450b-85a1-340d524ff55c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:47.396448 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6e20850c-7d73-450b-85a1-340d524ff55c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:47.402193 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e20850c-7d73-450b-85a1-340d524ff55c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:47.402634 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e20850c-7d73-450b-85a1-340d524ff55c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:47.403425 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e20850c-7d73-450b-85a1-340d524ff55c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:47.403933 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6e20850c-7d73-450b-85a1-340d524ff55c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:47.466757 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6e20850c-7d73-450b-85a1-340d524ff55c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:47.473938 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6e20850c-7d73-450b-85a1-340d524ff55c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.082399 Jul 19 09:37:47.474491 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 654/1335] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:47 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:48.490138 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7787cfed-9c8c-4407-b01c-233cb075a2d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:48.490693 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7787cfed-9c8c-4407-b01c-233cb075a2d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:48.496672 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7787cfed-9c8c-4407-b01c-233cb075a2d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:48.497132 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7787cfed-9c8c-4407-b01c-233cb075a2d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:48.497924 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7787cfed-9c8c-4407-b01c-233cb075a2d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:48.498361 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7787cfed-9c8c-4407-b01c-233cb075a2d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:48.557251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7787cfed-9c8c-4407-b01c-233cb075a2d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:48.564311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7787cfed-9c8c-4407-b01c-233cb075a2d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078496 Jul 19 09:37:48.564903 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 682/1336] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:48 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:49.581346 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a4dc1188-0851-4257-b2d9-e0f8355fc552 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:49.581882 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a4dc1188-0851-4257-b2d9-e0f8355fc552 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:49.587772 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4dc1188-0851-4257-b2d9-e0f8355fc552 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:49.588222 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4dc1188-0851-4257-b2d9-e0f8355fc552 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:49.588987 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4dc1188-0851-4257-b2d9-e0f8355fc552 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:49.589423 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a4dc1188-0851-4257-b2d9-e0f8355fc552 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:49.650680 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a4dc1188-0851-4257-b2d9-e0f8355fc552 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:49.658249 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a4dc1188-0851-4257-b2d9-e0f8355fc552 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.081123 Jul 19 09:37:49.658816 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 655/1337] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:49 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:50.675073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c3a0939b-fba4-493a-a01a-350893e6e370 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:50.675679 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c3a0939b-fba4-493a-a01a-350893e6e370 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:50.681530 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c3a0939b-fba4-493a-a01a-350893e6e370 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:50.681974 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c3a0939b-fba4-493a-a01a-350893e6e370 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:50.682728 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c3a0939b-fba4-493a-a01a-350893e6e370 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:50.683196 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c3a0939b-fba4-493a-a01a-350893e6e370 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:50.744391 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c3a0939b-fba4-493a-a01a-350893e6e370 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:50.751418 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c3a0939b-fba4-493a-a01a-350893e6e370 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.080065 Jul 19 09:37:50.751976 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 683/1338] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:50 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:51.769075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-da30d6e6-7872-4233-835a-f64c7d82669e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:51.769711 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-da30d6e6-7872-4233-835a-f64c7d82669e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:51.775398 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-da30d6e6-7872-4233-835a-f64c7d82669e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:51.775838 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-da30d6e6-7872-4233-835a-f64c7d82669e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:51.776589 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-da30d6e6-7872-4233-835a-f64c7d82669e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:51.777012 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-da30d6e6-7872-4233-835a-f64c7d82669e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:51.836708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-da30d6e6-7872-4233-835a-f64c7d82669e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:51.843889 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-da30d6e6-7872-4233-835a-f64c7d82669e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078585 Jul 19 09:37:51.844440 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 656/1339] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:51 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:52.860860 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-315c6939-2054-4799-ae98-75e30f8c0699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:52.861450 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-315c6939-2054-4799-ae98-75e30f8c0699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:52.867883 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-315c6939-2054-4799-ae98-75e30f8c0699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:52.868332 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-315c6939-2054-4799-ae98-75e30f8c0699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:52.869087 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-315c6939-2054-4799-ae98-75e30f8c0699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:52.869516 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-315c6939-2054-4799-ae98-75e30f8c0699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:52.927989 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-315c6939-2054-4799-ae98-75e30f8c0699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:52.934979 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-315c6939-2054-4799-ae98-75e30f8c0699 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077800 Jul 19 09:37:52.935567 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 684/1340] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:52 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:53.951003 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0bae0138-1837-42cc-b226-09b78f9c9311 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:53.951637 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0bae0138-1837-42cc-b226-09b78f9c9311 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:53.957410 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0bae0138-1837-42cc-b226-09b78f9c9311 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:53.957864 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0bae0138-1837-42cc-b226-09b78f9c9311 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:53.958647 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0bae0138-1837-42cc-b226-09b78f9c9311 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:53.959710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0bae0138-1837-42cc-b226-09b78f9c9311 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:54.018661 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0bae0138-1837-42cc-b226-09b78f9c9311 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:54.026419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0bae0138-1837-42cc-b226-09b78f9c9311 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079054 Jul 19 09:37:54.026982 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 657/1341] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:53 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:55.043613 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7b678cb6-a606-42d7-b06e-6094f614deda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:55.044214 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7b678cb6-a606-42d7-b06e-6094f614deda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:55.050049 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b678cb6-a606-42d7-b06e-6094f614deda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:55.050491 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b678cb6-a606-42d7-b06e-6094f614deda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:55.051271 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b678cb6-a606-42d7-b06e-6094f614deda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:55.051701 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7b678cb6-a606-42d7-b06e-6094f614deda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:55.117626 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7b678cb6-a606-42d7-b06e-6094f614deda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:55.124950 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7b678cb6-a606-42d7-b06e-6094f614deda tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.085024 Jul 19 09:37:55.125503 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 685/1342] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:55 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:56.142405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-960b0a5b-3755-4826-a053-86264d7bb525 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:56.143011 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-960b0a5b-3755-4826-a053-86264d7bb525 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:56.148823 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-960b0a5b-3755-4826-a053-86264d7bb525 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:56.149268 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-960b0a5b-3755-4826-a053-86264d7bb525 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:56.150024 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-960b0a5b-3755-4826-a053-86264d7bb525 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:56.150452 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-960b0a5b-3755-4826-a053-86264d7bb525 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:56.214425 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-960b0a5b-3755-4826-a053-86264d7bb525 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:56.221540 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-960b0a5b-3755-4826-a053-86264d7bb525 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.082820 Jul 19 09:37:56.222106 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 658/1343] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:56 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:57.239005 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c866957e-8ea4-4ed9-9545-950a02585cc7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:57.239623 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c866957e-8ea4-4ed9-9545-950a02585cc7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:57.245848 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c866957e-8ea4-4ed9-9545-950a02585cc7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:57.246293 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c866957e-8ea4-4ed9-9545-950a02585cc7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:57.247062 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c866957e-8ea4-4ed9-9545-950a02585cc7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:57.247488 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c866957e-8ea4-4ed9-9545-950a02585cc7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:57.305556 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c866957e-8ea4-4ed9-9545-950a02585cc7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:57.312502 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c866957e-8ea4-4ed9-9545-950a02585cc7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077215 Jul 19 09:37:57.313056 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 686/1344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:57 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:58.329855 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0897c2e7-e8b3-41cb-94c3-09012bc611d7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:58.330458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0897c2e7-e8b3-41cb-94c3-09012bc611d7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:58.332822 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 09:37:58.337715 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0897c2e7-e8b3-41cb-94c3-09012bc611d7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:58.338158 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0897c2e7-e8b3-41cb-94c3-09012bc611d7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:58.338908 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0897c2e7-e8b3-41cb-94c3-09012bc611d7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:58.339361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0897c2e7-e8b3-41cb-94c3-09012bc611d7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:58.397441 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0897c2e7-e8b3-41cb-94c3-09012bc611d7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:58.405014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0897c2e7-e8b3-41cb-94c3-09012bc611d7 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078854 Jul 19 09:37:58.405572 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 659/1345] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:58 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:37:59.421521 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-50873e5b-553a-4ccd-afe9-75cc8d23e2bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:37:59.422067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-50873e5b-553a-4ccd-afe9-75cc8d23e2bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:37:59.427849 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-50873e5b-553a-4ccd-afe9-75cc8d23e2bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:59.428297 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-50873e5b-553a-4ccd-afe9-75cc8d23e2bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:59.429066 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-50873e5b-553a-4ccd-afe9-75cc8d23e2bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:37:59.429499 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-50873e5b-553a-4ccd-afe9-75cc8d23e2bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:37:59.487632 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-50873e5b-553a-4ccd-afe9-75cc8d23e2bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:37:59.495394 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-50873e5b-553a-4ccd-afe9-75cc8d23e2bf tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077521 Jul 19 09:37:59.495952 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 687/1346] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:37:59 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:00.512415 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7f45d393-ed16-4643-a8c5-83d9913f3061 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:00.513024 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7f45d393-ed16-4643-a8c5-83d9913f3061 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:00.529137 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7f45d393-ed16-4643-a8c5-83d9913f3061 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:00.529590 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7f45d393-ed16-4643-a8c5-83d9913f3061 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:00.530347 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7f45d393-ed16-4643-a8c5-83d9913f3061 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:00.530776 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7f45d393-ed16-4643-a8c5-83d9913f3061 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:00.536303 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56354. Jul 19 09:38:00.591905 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7f45d393-ed16-4643-a8c5-83d9913f3061 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:00.598913 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7f45d393-ed16-4643-a8c5-83d9913f3061 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.090190 Jul 19 09:38:00.599573 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 660/1347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:00 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:38:01.615431 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f5ce08cc-4029-40f4-9afc-82810fe9fe7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:01.615979 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f5ce08cc-4029-40f4-9afc-82810fe9fe7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:01.622416 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5ce08cc-4029-40f4-9afc-82810fe9fe7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:01.622867 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5ce08cc-4029-40f4-9afc-82810fe9fe7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:01.623661 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5ce08cc-4029-40f4-9afc-82810fe9fe7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:01.624094 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5ce08cc-4029-40f4-9afc-82810fe9fe7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:01.683057 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f5ce08cc-4029-40f4-9afc-82810fe9fe7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:01.690171 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f5ce08cc-4029-40f4-9afc-82810fe9fe7d tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078495 Jul 19 09:38:01.690732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 688/1348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:01 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:02.706592 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-14ff1489-d12b-4464-80f1-5f2a927d3306 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:02.707225 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-14ff1489-d12b-4464-80f1-5f2a927d3306 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:02.713458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14ff1489-d12b-4464-80f1-5f2a927d3306 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:02.713910 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14ff1489-d12b-4464-80f1-5f2a927d3306 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:02.714681 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14ff1489-d12b-4464-80f1-5f2a927d3306 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:02.715143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14ff1489-d12b-4464-80f1-5f2a927d3306 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:02.773498 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-14ff1489-d12b-4464-80f1-5f2a927d3306 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:02.780694 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-14ff1489-d12b-4464-80f1-5f2a927d3306 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077808 Jul 19 09:38:02.781256 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 661/1349] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:02 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:03.798093 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-63aab759-1777-46ec-9cf8-0b8515a344dc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:03.798621 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-63aab759-1777-46ec-9cf8-0b8515a344dc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:03.804933 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-63aab759-1777-46ec-9cf8-0b8515a344dc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:03.805372 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-63aab759-1777-46ec-9cf8-0b8515a344dc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:03.806118 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-63aab759-1777-46ec-9cf8-0b8515a344dc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:03.806545 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-63aab759-1777-46ec-9cf8-0b8515a344dc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:03.867480 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-63aab759-1777-46ec-9cf8-0b8515a344dc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:03.874757 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-63aab759-1777-46ec-9cf8-0b8515a344dc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.080428 Jul 19 09:38:03.875357 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 689/1350] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:03 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:04.891595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-54cd738a-19cb-4e4d-9233-55dde19ab745 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:04.892200 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-54cd738a-19cb-4e4d-9233-55dde19ab745 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:04.898593 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-54cd738a-19cb-4e4d-9233-55dde19ab745 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:04.899061 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-54cd738a-19cb-4e4d-9233-55dde19ab745 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:04.899810 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-54cd738a-19cb-4e4d-9233-55dde19ab745 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:04.900237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-54cd738a-19cb-4e4d-9233-55dde19ab745 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:04.962477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-54cd738a-19cb-4e4d-9233-55dde19ab745 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:04.969599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-54cd738a-19cb-4e4d-9233-55dde19ab745 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.081636 Jul 19 09:38:04.970160 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 662/1351] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:04 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:05.985930 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-83a3f833-861a-46f8-ba83-98c9f92436cc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:05.986565 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-83a3f833-861a-46f8-ba83-98c9f92436cc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:05.993340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-83a3f833-861a-46f8-ba83-98c9f92436cc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:05.994050 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-83a3f833-861a-46f8-ba83-98c9f92436cc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:05.994817 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-83a3f833-861a-46f8-ba83-98c9f92436cc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:05.995282 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-83a3f833-861a-46f8-ba83-98c9f92436cc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:06.055555 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-83a3f833-861a-46f8-ba83-98c9f92436cc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:06.062684 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-83a3f833-861a-46f8-ba83-98c9f92436cc tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.080372 Jul 19 09:38:06.063204 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 690/1352] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:05 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:07.079303 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c7aa8d86-0291-4d44-bcf0-7e2f74887522 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:07.079945 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c7aa8d86-0291-4d44-bcf0-7e2f74887522 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:07.085757 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7aa8d86-0291-4d44-bcf0-7e2f74887522 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:07.086212 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7aa8d86-0291-4d44-bcf0-7e2f74887522 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:07.086980 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7aa8d86-0291-4d44-bcf0-7e2f74887522 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:07.087443 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7aa8d86-0291-4d44-bcf0-7e2f74887522 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:07.147161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c7aa8d86-0291-4d44-bcf0-7e2f74887522 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:07.155285 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c7aa8d86-0291-4d44-bcf0-7e2f74887522 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079616 Jul 19 09:38:07.155850 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 663/1353] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:07 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:08.172020 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e5740045-a4d9-4606-8f96-9a6f4567cc0c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:08.172623 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e5740045-a4d9-4606-8f96-9a6f4567cc0c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:08.178336 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e5740045-a4d9-4606-8f96-9a6f4567cc0c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:08.179349 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e5740045-a4d9-4606-8f96-9a6f4567cc0c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:08.180094 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e5740045-a4d9-4606-8f96-9a6f4567cc0c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:08.180519 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e5740045-a4d9-4606-8f96-9a6f4567cc0c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:08.238789 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e5740045-a4d9-4606-8f96-9a6f4567cc0c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:08.246174 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e5740045-a4d9-4606-8f96-9a6f4567cc0c tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077829 Jul 19 09:38:08.246730 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 691/1354] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:08 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:09.263521 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9ec36055-f64e-4585-a9d9-88e6493c5876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:09.264159 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9ec36055-f64e-4585-a9d9-88e6493c5876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:09.270046 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ec36055-f64e-4585-a9d9-88e6493c5876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:09.270502 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ec36055-f64e-4585-a9d9-88e6493c5876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:09.271322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ec36055-f64e-4585-a9d9-88e6493c5876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:09.271798 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ec36055-f64e-4585-a9d9-88e6493c5876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:09.331880 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9ec36055-f64e-4585-a9d9-88e6493c5876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:09.339660 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9ec36055-f64e-4585-a9d9-88e6493c5876 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079954 Jul 19 09:38:09.340223 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 664/1355] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:09 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:10.356829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-564de3e6-3ce9-489e-abd9-884ab30574a4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:10.357460 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-564de3e6-3ce9-489e-abd9-884ab30574a4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:10.363310 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-564de3e6-3ce9-489e-abd9-884ab30574a4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:10.363760 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-564de3e6-3ce9-489e-abd9-884ab30574a4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:10.364518 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-564de3e6-3ce9-489e-abd9-884ab30574a4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:10.364948 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-564de3e6-3ce9-489e-abd9-884ab30574a4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:10.424435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-564de3e6-3ce9-489e-abd9-884ab30574a4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:10.431560 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-564de3e6-3ce9-489e-abd9-884ab30574a4 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.078421 Jul 19 09:38:10.432118 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 692/1356] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:10 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:11.447546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-620eb753-7ea6-4066-8897-c0717ce3efb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:11.448076 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-620eb753-7ea6-4066-8897-c0717ce3efb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:11.453795 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-620eb753-7ea6-4066-8897-c0717ce3efb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:11.454245 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-620eb753-7ea6-4066-8897-c0717ce3efb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:11.455059 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-620eb753-7ea6-4066-8897-c0717ce3efb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:11.455496 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-620eb753-7ea6-4066-8897-c0717ce3efb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:11.514405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-620eb753-7ea6-4066-8897-c0717ce3efb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:11.521579 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-620eb753-7ea6-4066-8897-c0717ce3efb0 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077773 Jul 19 09:38:11.522147 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 665/1357] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:11 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:12.538150 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c4685ac4-2487-493b-95bd-ae3290ee214a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:12.539312 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c4685ac4-2487-493b-95bd-ae3290ee214a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:12.545113 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c4685ac4-2487-493b-95bd-ae3290ee214a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:12.545560 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c4685ac4-2487-493b-95bd-ae3290ee214a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:12.546339 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c4685ac4-2487-493b-95bd-ae3290ee214a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:12.546778 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c4685ac4-2487-493b-95bd-ae3290ee214a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:12.608057 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c4685ac4-2487-493b-95bd-ae3290ee214a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:12.615216 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c4685ac4-2487-493b-95bd-ae3290ee214a tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.081015 Jul 19 09:38:12.615773 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 693/1358] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:12 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:13.631216 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ba196418-bef8-4795-adef-7f862054a2f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:13.631768 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ba196418-bef8-4795-adef-7f862054a2f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:13.637558 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba196418-bef8-4795-adef-7f862054a2f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:13.638014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba196418-bef8-4795-adef-7f862054a2f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:13.638775 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba196418-bef8-4795-adef-7f862054a2f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:13.639238 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba196418-bef8-4795-adef-7f862054a2f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:13.702197 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ba196418-bef8-4795-adef-7f862054a2f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:13.709408 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ba196418-bef8-4795-adef-7f862054a2f9 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.081992 Jul 19 09:38:13.709966 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 666/1359] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:13 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:14.725828 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7a998b10-0e1c-4c9f-aaa3-f3f9e65a329f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:14.726428 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7a998b10-0e1c-4c9f-aaa3-f3f9e65a329f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:14.732173 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7a998b10-0e1c-4c9f-aaa3-f3f9e65a329f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:14.732619 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7a998b10-0e1c-4c9f-aaa3-f3f9e65a329f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:14.733363 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7a998b10-0e1c-4c9f-aaa3-f3f9e65a329f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:14.733791 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7a998b10-0e1c-4c9f-aaa3-f3f9e65a329f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:14.792652 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7a998b10-0e1c-4c9f-aaa3-f3f9e65a329f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:14.799798 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7a998b10-0e1c-4c9f-aaa3-f3f9e65a329f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077582 Jul 19 09:38:14.800361 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 694/1360] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:14 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:15.816892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b710a682-eb08-4a3d-b03d-35a690dc03d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:15.817632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b710a682-eb08-4a3d-b03d-35a690dc03d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:15.824026 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b710a682-eb08-4a3d-b03d-35a690dc03d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:15.824469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b710a682-eb08-4a3d-b03d-35a690dc03d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:15.825221 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b710a682-eb08-4a3d-b03d-35a690dc03d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:15.825710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b710a682-eb08-4a3d-b03d-35a690dc03d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:15.886057 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b710a682-eb08-4a3d-b03d-35a690dc03d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:15.893644 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b710a682-eb08-4a3d-b03d-35a690dc03d5 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.080359 Jul 19 09:38:15.894199 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 667/1361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:15 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:16.910669 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-13e9ac0b-0a08-4e58-a533-ff1f1c75a750 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:16.911302 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-13e9ac0b-0a08-4e58-a533-ff1f1c75a750 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:16.917949 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-13e9ac0b-0a08-4e58-a533-ff1f1c75a750 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:16.918393 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-13e9ac0b-0a08-4e58-a533-ff1f1c75a750 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:16.919240 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-13e9ac0b-0a08-4e58-a533-ff1f1c75a750 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:16.919675 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-13e9ac0b-0a08-4e58-a533-ff1f1c75a750 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:16.977273 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-13e9ac0b-0a08-4e58-a533-ff1f1c75a750 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:16.984971 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-13e9ac0b-0a08-4e58-a533-ff1f1c75a750 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.077915 Jul 19 09:38:16.985538 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 695/1362] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:16 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:18.001453 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-13523256-4cf3-4026-89ab-a7dbbb831272 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:18.002092 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-13523256-4cf3-4026-89ab-a7dbbb831272 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:18.008042 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13523256-4cf3-4026-89ab-a7dbbb831272 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:18.008490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13523256-4cf3-4026-89ab-a7dbbb831272 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:18.009259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13523256-4cf3-4026-89ab-a7dbbb831272 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:18.009695 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-13523256-4cf3-4026-89ab-a7dbbb831272 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:18.069986 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-13523256-4cf3-4026-89ab-a7dbbb831272 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:18.077305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-13523256-4cf3-4026-89ab-a7dbbb831272 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079508 Jul 19 09:38:18.077869 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 668/1363] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:17 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:38:19.093636 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4cd113a7-b842-4835-ada4-b0e5baaae44f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:19.094229 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4cd113a7-b842-4835-ada4-b0e5baaae44f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:19.100026 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4cd113a7-b842-4835-ada4-b0e5baaae44f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:19.100473 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4cd113a7-b842-4835-ada4-b0e5baaae44f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:19.101228 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4cd113a7-b842-4835-ada4-b0e5baaae44f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:19.101654 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4cd113a7-b842-4835-ada4-b0e5baaae44f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:19.160854 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4cd113a7-b842-4835-ada4-b0e5baaae44f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:19.169138 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4cd113a7-b842-4835-ada4-b0e5baaae44f tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1219 microversion: 2.1 time: 0.079115 Jul 19 09:38:19.169709 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 696/1364] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:19 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:20.186870 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e2e68f70-34ee-4b02-8d03-f20a892a6f05 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:20.187758 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e2e68f70-34ee-4b02-8d03-f20a892a6f05 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:20.194062 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e2e68f70-34ee-4b02-8d03-f20a892a6f05 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:20.194635 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e2e68f70-34ee-4b02-8d03-f20a892a6f05 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:20.195449 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e2e68f70-34ee-4b02-8d03-f20a892a6f05 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:20.196067 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e2e68f70-34ee-4b02-8d03-f20a892a6f05 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:20.228532 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e2e68f70-34ee-4b02-8d03-f20a892a6f05 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:20.228985 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e2e68f70-34ee-4b02-8d03-f20a892a6f05 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:20.229429 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.objects.instance [None req-e2e68f70-34ee-4b02-8d03-f20a892a6f05 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lazy-loading 'fault' on Instance uuid ee02e36e-7587-4ab3-b367-08e1c9b26c69 {{(pid=107464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:38:20.269445 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e2e68f70-34ee-4b02-8d03-f20a892a6f05 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a447ab1e5e9a4660b457e639d7e96339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2bfe61cc3e4e789667d6a0ac2792a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:38:20.276647 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e2e68f70-34ee-4b02-8d03-f20a892a6f05 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 200 len: 1313 microversion: 2.1 time: 0.094266 Jul 19 09:38:20.277209 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 669/1365] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:20 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 1313 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:21.293600 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b7f3b59a-5ffd-4247-8a96-282db299ef9e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:21.294126 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b7f3b59a-5ffd-4247-8a96-282db299ef9e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] [instance: ee02e36e-7587-4ab3-b367-08e1c9b26c69] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:38:21.299775 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7f3b59a-5ffd-4247-8a96-282db299ef9e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:21.300214 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7f3b59a-5ffd-4247-8a96-282db299ef9e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:21.300964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7f3b59a-5ffd-4247-8a96-282db299ef9e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:38:21.301391 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7f3b59a-5ffd-4247-8a96-282db299ef9e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:38:21.314211 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-b7f3b59a-5ffd-4247-8a96-282db299ef9e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] HTTP exception thrown: Instance ee02e36e-7587-4ab3-b367-08e1c9b26c69 could not be found. Jul 19 09:38:21.314780 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b7f3b59a-5ffd-4247-8a96-282db299ef9e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Returning 404 to user: Instance ee02e36e-7587-4ab3-b367-08e1c9b26c69 could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:38:21.315603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b7f3b59a-5ffd-4247-8a96-282db299ef9e tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69" status: 404 len: 111 microversion: 2.1 time: 0.025798 Jul 19 09:38:21.316099 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 697/1366] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:38:21 2021] GET /compute/v2.1/servers/ee02e36e-7587-4ab3-b367-08e1c9b26c69 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:38:21.471256 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-737fba1c-ddee-4a18-bb96-2864037753d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] Calling method '.version_select at 0x7f04b01ede50>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:38:21.494274 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-737fba1c-ddee-4a18-bb96-2864037753d2 tempest-TestShelveInstance-95513548 tempest-TestShelveInstance-95513548-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-260386788" status: 202 len: 0 microversion: 2.1 time: 0.026641 Jul 19 09:38:21.494981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 670/1367] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Jul 19 09:38:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-260386788 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:38:39.730281 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c0700d60-be52-4ed6-bcc3-16532d72f503 tempest-TestVolumeBootPattern-575772111 tempest-TestVolumeBootPattern-575772111-project] Action: 'create', calling method: .version_select at 0x7f04b020d1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1217974293"}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:38:39.748650 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-c0700d60-be52-4ed6-bcc3-16532d72f503 tempest-TestVolumeBootPattern-575772111 tempest-TestVolumeBootPattern-575772111-project] Getting quotas for project e2254142854e4bfda8511c9c1242e0b7. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:38:39.752897 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-c0700d60-be52-4ed6-bcc3-16532d72f503 tempest-TestVolumeBootPattern-575772111 tempest-TestVolumeBootPattern-575772111-project] Getting quotas for user b6ab26f2e30540b6b65c95fab90b3dcb and project e2254142854e4bfda8511c9c1242e0b7. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:38:39.904834 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-c0700d60-be52-4ed6-bcc3-16532d72f503 tempest-TestVolumeBootPattern-575772111 tempest-TestVolumeBootPattern-575772111-project] Getting quotas for project e2254142854e4bfda8511c9c1242e0b7. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:38:39.908645 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-c0700d60-be52-4ed6-bcc3-16532d72f503 tempest-TestVolumeBootPattern-575772111 tempest-TestVolumeBootPattern-575772111-project] Getting quotas for user b6ab26f2e30540b6b65c95fab90b3dcb and project e2254142854e4bfda8511c9c1242e0b7. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:38:39.922358 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c0700d60-be52-4ed6-bcc3-16532d72f503 tempest-TestVolumeBootPattern-575772111 tempest-TestVolumeBootPattern-575772111-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.356713 Jul 19 09:38:39.923364 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 698/1368] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jul 19 09:38:39 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:38:48.692361 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:38:48.692967 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:38:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:39:06.316377 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:39:06.316880 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:39:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:40:15.191790 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:40:15.192409 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:40:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:40:16.392552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-05cbd2a6-dc2d-4f18-9aea-49c9b2e45713 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:16.393148 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-05cbd2a6-dc2d-4f18-9aea-49c9b2e45713 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:16.399939 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-05cbd2a6-dc2d-4f18-9aea-49c9b2e45713 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:16.400392 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-05cbd2a6-dc2d-4f18-9aea-49c9b2e45713 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:16.401163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-05cbd2a6-dc2d-4f18-9aea-49c9b2e45713 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:16.401601 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-05cbd2a6-dc2d-4f18-9aea-49c9b2e45713 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:16.426798 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-05cbd2a6-dc2d-4f18-9aea-49c9b2e45713 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Going to try to terminate instance {{(pid=107464) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:40:16.501589 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-05cbd2a6-dc2d-4f18-9aea-49c9b2e45713 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "DELETE /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 204 len: 0 microversion: 2.1 time: 0.114046 Jul 19 09:40:16.502169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 671/1369] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:40:16 2021] DELETE /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 09:40:16.507871 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 09:40:16.511475 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a0230aa7-2d81-4f71-8bef-67a4c4343ff3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:16.512646 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a0230aa7-2d81-4f71-8bef-67a4c4343ff3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:16.519064 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a0230aa7-2d81-4f71-8bef-67a4c4343ff3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:16.519530 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a0230aa7-2d81-4f71-8bef-67a4c4343ff3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:16.520290 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a0230aa7-2d81-4f71-8bef-67a4c4343ff3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:16.520727 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a0230aa7-2d81-4f71-8bef-67a4c4343ff3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:16.774177 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a0230aa7-2d81-4f71-8bef-67a4c4343ff3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:16.781890 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a0230aa7-2d81-4f71-8bef-67a4c4343ff3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1560 microversion: 2.1 time: 0.275535 Jul 19 09:40:16.782452 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 699/1370] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:16 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1560 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:40:17.768766 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-811947a0-225d-490c-87a2-bb950c4c7333 req-8261753f-11c8-4c00-97a1-f26b34399d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36be7eb9-715d-4855-9896-49929b6d5013", "name": "network-vif-deleted", "tag": "0945ccd4-7d3c-4acc-a559-260dab74f7fe"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:40:17.770718 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:40:17.770718 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:40:17.777606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-811947a0-225d-490c-87a2-bb950c4c7333 req-8261753f-11c8-4c00-97a1-f26b34399d5d service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:17.778801 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-811947a0-225d-490c-87a2-bb950c4c7333 req-8261753f-11c8-4c00-97a1-f26b34399d5d service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:17.790337 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-811947a0-225d-490c-87a2-bb950c4c7333 req-8261753f-11c8-4c00-97a1-f26b34399d5d service nova] Creating event network-vif-deleted:0945ccd4-7d3c-4acc-a559-260dab74f7fe for instance 36be7eb9-715d-4855-9896-49929b6d5013 on hv-cinder-79338 Jul 19 09:40:17.796486 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-811947a0-225d-490c-87a2-bb950c4c7333 req-8261753f-11c8-4c00-97a1-f26b34399d5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086166 Jul 19 09:40:17.797223 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 672/1371] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:40:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 09:40:17.800037 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-16706455-5b66-4fde-a282-e36ff3f8d722 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:17.800841 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-16706455-5b66-4fde-a282-e36ff3f8d722 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:17.817275 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16706455-5b66-4fde-a282-e36ff3f8d722 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:17.817719 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16706455-5b66-4fde-a282-e36ff3f8d722 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:17.818483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16706455-5b66-4fde-a282-e36ff3f8d722 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:17.818914 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16706455-5b66-4fde-a282-e36ff3f8d722 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:17.837644 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57922. Jul 19 09:40:17.880848 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-16706455-5b66-4fde-a282-e36ff3f8d722 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:17.888880 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-16706455-5b66-4fde-a282-e36ff3f8d722 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.093277 Jul 19 09:40:17.889432 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 700/1372] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:17 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:40:18.905117 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9101b6dd-3ef8-48d7-8fe3-b3055929198e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:18.905803 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9101b6dd-3ef8-48d7-8fe3-b3055929198e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:18.911708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9101b6dd-3ef8-48d7-8fe3-b3055929198e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:18.912149 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9101b6dd-3ef8-48d7-8fe3-b3055929198e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:18.912900 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9101b6dd-3ef8-48d7-8fe3-b3055929198e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:18.913324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9101b6dd-3ef8-48d7-8fe3-b3055929198e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:19.018890 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9101b6dd-3ef8-48d7-8fe3-b3055929198e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:19.026519 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9101b6dd-3ef8-48d7-8fe3-b3055929198e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.125866 Jul 19 09:40:19.027084 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 673/1373] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:18 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:20.044028 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-43f71ee0-da6a-42cc-9f36-4a23c7064e1c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:20.044639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-43f71ee0-da6a-42cc-9f36-4a23c7064e1c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:20.050353 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-43f71ee0-da6a-42cc-9f36-4a23c7064e1c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:20.050798 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-43f71ee0-da6a-42cc-9f36-4a23c7064e1c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:20.051585 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-43f71ee0-da6a-42cc-9f36-4a23c7064e1c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:20.052018 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-43f71ee0-da6a-42cc-9f36-4a23c7064e1c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:20.111934 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-43f71ee0-da6a-42cc-9f36-4a23c7064e1c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:20.119529 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-43f71ee0-da6a-42cc-9f36-4a23c7064e1c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079530 Jul 19 09:40:20.120127 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 701/1374] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:20 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:21.136665 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3a5eeab0-5fdb-4f72-accd-081d45411094 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:21.137907 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3a5eeab0-5fdb-4f72-accd-081d45411094 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:21.144077 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3a5eeab0-5fdb-4f72-accd-081d45411094 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:21.144537 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3a5eeab0-5fdb-4f72-accd-081d45411094 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:21.145336 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3a5eeab0-5fdb-4f72-accd-081d45411094 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:21.145771 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3a5eeab0-5fdb-4f72-accd-081d45411094 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:21.207522 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3a5eeab0-5fdb-4f72-accd-081d45411094 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:21.215028 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3a5eeab0-5fdb-4f72-accd-081d45411094 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.082021 Jul 19 09:40:21.215611 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 674/1375] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:21 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:22.231481 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-36d1b7ee-afc0-4d55-94d6-5062824a8d63 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:22.232014 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-36d1b7ee-afc0-4d55-94d6-5062824a8d63 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:22.237753 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-36d1b7ee-afc0-4d55-94d6-5062824a8d63 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:22.238228 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-36d1b7ee-afc0-4d55-94d6-5062824a8d63 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:22.238975 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-36d1b7ee-afc0-4d55-94d6-5062824a8d63 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:22.239427 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-36d1b7ee-afc0-4d55-94d6-5062824a8d63 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:22.298361 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-36d1b7ee-afc0-4d55-94d6-5062824a8d63 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:22.305784 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-36d1b7ee-afc0-4d55-94d6-5062824a8d63 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.077986 Jul 19 09:40:22.306338 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 702/1376] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:22 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:23.321886 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4f607600-536b-4273-9e30-5465411c5bb2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:23.322458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4f607600-536b-4273-9e30-5465411c5bb2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:23.328262 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4f607600-536b-4273-9e30-5465411c5bb2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:23.328708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4f607600-536b-4273-9e30-5465411c5bb2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:23.329494 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4f607600-536b-4273-9e30-5465411c5bb2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:23.329924 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4f607600-536b-4273-9e30-5465411c5bb2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:23.389686 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4f607600-536b-4273-9e30-5465411c5bb2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:23.397523 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4f607600-536b-4273-9e30-5465411c5bb2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079313 Jul 19 09:40:23.398289 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 675/1377] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:23 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:24.414457 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-34e7e19b-287e-4832-b340-586d5b226503 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:24.415085 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-34e7e19b-287e-4832-b340-586d5b226503 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:24.421316 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-34e7e19b-287e-4832-b340-586d5b226503 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:24.421765 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-34e7e19b-287e-4832-b340-586d5b226503 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:24.422524 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-34e7e19b-287e-4832-b340-586d5b226503 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:24.422951 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-34e7e19b-287e-4832-b340-586d5b226503 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:24.485069 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-34e7e19b-287e-4832-b340-586d5b226503 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:24.492684 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-34e7e19b-287e-4832-b340-586d5b226503 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.081988 Jul 19 09:40:24.493241 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 703/1378] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:24 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:25.509247 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0c0842e1-485e-4902-b282-4ba7a54a94a5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:25.509878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0c0842e1-485e-4902-b282-4ba7a54a94a5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:25.516124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c0842e1-485e-4902-b282-4ba7a54a94a5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:25.516565 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c0842e1-485e-4902-b282-4ba7a54a94a5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:25.517307 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c0842e1-485e-4902-b282-4ba7a54a94a5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:25.517761 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c0842e1-485e-4902-b282-4ba7a54a94a5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:25.581971 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0c0842e1-485e-4902-b282-4ba7a54a94a5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:25.589746 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0c0842e1-485e-4902-b282-4ba7a54a94a5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.084084 Jul 19 09:40:25.590303 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 676/1379] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:25 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:26.606851 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d96792b8-ab0f-4d1c-a35e-892b2ce4596b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:26.607482 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d96792b8-ab0f-4d1c-a35e-892b2ce4596b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:26.613190 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d96792b8-ab0f-4d1c-a35e-892b2ce4596b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:26.613634 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d96792b8-ab0f-4d1c-a35e-892b2ce4596b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:26.614383 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d96792b8-ab0f-4d1c-a35e-892b2ce4596b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:26.614810 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d96792b8-ab0f-4d1c-a35e-892b2ce4596b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:26.675012 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d96792b8-ab0f-4d1c-a35e-892b2ce4596b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:26.682629 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d96792b8-ab0f-4d1c-a35e-892b2ce4596b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079897 Jul 19 09:40:26.683217 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 704/1380] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:26 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:27.700572 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e70c0f42-77ce-4bf8-bcf2-df9541dab676 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:27.701187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e70c0f42-77ce-4bf8-bcf2-df9541dab676 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:27.707480 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e70c0f42-77ce-4bf8-bcf2-df9541dab676 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:27.707929 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e70c0f42-77ce-4bf8-bcf2-df9541dab676 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:27.709043 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e70c0f42-77ce-4bf8-bcf2-df9541dab676 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:27.709483 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e70c0f42-77ce-4bf8-bcf2-df9541dab676 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:27.769313 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e70c0f42-77ce-4bf8-bcf2-df9541dab676 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:27.777011 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e70c0f42-77ce-4bf8-bcf2-df9541dab676 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080938 Jul 19 09:40:27.777624 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 677/1381] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:27 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:28.794043 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3bce8826-44dd-4169-bb95-1842bc19dbc9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:28.794646 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3bce8826-44dd-4169-bb95-1842bc19dbc9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:28.800618 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3bce8826-44dd-4169-bb95-1842bc19dbc9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:28.801075 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3bce8826-44dd-4169-bb95-1842bc19dbc9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:28.801850 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3bce8826-44dd-4169-bb95-1842bc19dbc9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:28.802286 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3bce8826-44dd-4169-bb95-1842bc19dbc9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:28.861237 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3bce8826-44dd-4169-bb95-1842bc19dbc9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:28.868860 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3bce8826-44dd-4169-bb95-1842bc19dbc9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078921 Jul 19 09:40:28.869542 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 705/1382] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:28 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:29.885165 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6decd297-d61a-4c7c-9293-aa3ce8fc06ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:29.885775 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6decd297-d61a-4c7c-9293-aa3ce8fc06ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:29.892038 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6decd297-d61a-4c7c-9293-aa3ce8fc06ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:29.892482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6decd297-d61a-4c7c-9293-aa3ce8fc06ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:29.893234 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6decd297-d61a-4c7c-9293-aa3ce8fc06ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:29.893661 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6decd297-d61a-4c7c-9293-aa3ce8fc06ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:29.953639 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6decd297-d61a-4c7c-9293-aa3ce8fc06ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:29.961549 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6decd297-d61a-4c7c-9293-aa3ce8fc06ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079981 Jul 19 09:40:29.962145 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 678/1383] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:29 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:30.979383 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b8e6871b-e5aa-4cff-a811-d2e1af7f9972 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:30.979992 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b8e6871b-e5aa-4cff-a811-d2e1af7f9972 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:30.986574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b8e6871b-e5aa-4cff-a811-d2e1af7f9972 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:30.987022 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b8e6871b-e5aa-4cff-a811-d2e1af7f9972 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:30.987803 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b8e6871b-e5aa-4cff-a811-d2e1af7f9972 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:30.988231 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b8e6871b-e5aa-4cff-a811-d2e1af7f9972 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:31.048280 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b8e6871b-e5aa-4cff-a811-d2e1af7f9972 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:31.056549 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b8e6871b-e5aa-4cff-a811-d2e1af7f9972 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080855 Jul 19 09:40:31.057114 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 706/1384] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:30 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:32.072275 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2e5f7c4c-eb13-4da5-bdbc-4b260940f126 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:32.072884 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2e5f7c4c-eb13-4da5-bdbc-4b260940f126 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:32.079266 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2e5f7c4c-eb13-4da5-bdbc-4b260940f126 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:32.079717 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2e5f7c4c-eb13-4da5-bdbc-4b260940f126 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:32.080481 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2e5f7c4c-eb13-4da5-bdbc-4b260940f126 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:32.080913 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2e5f7c4c-eb13-4da5-bdbc-4b260940f126 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:32.141647 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2e5f7c4c-eb13-4da5-bdbc-4b260940f126 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:32.149473 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2e5f7c4c-eb13-4da5-bdbc-4b260940f126 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080778 Jul 19 09:40:32.150028 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 679/1385] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:32 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:33.166625 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-04bd8a96-b62e-4b17-8d91-2f607231038b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:33.167652 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-04bd8a96-b62e-4b17-8d91-2f607231038b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:33.173157 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-04bd8a96-b62e-4b17-8d91-2f607231038b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:33.173606 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-04bd8a96-b62e-4b17-8d91-2f607231038b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:33.174365 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-04bd8a96-b62e-4b17-8d91-2f607231038b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:33.174794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-04bd8a96-b62e-4b17-8d91-2f607231038b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:33.237300 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-04bd8a96-b62e-4b17-8d91-2f607231038b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:33.244732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-04bd8a96-b62e-4b17-8d91-2f607231038b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.082070 Jul 19 09:40:33.245293 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 707/1386] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:33 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:34.261260 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-946de5c8-1399-4331-9901-983168af2d7b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:34.262360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-946de5c8-1399-4331-9901-983168af2d7b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:34.268037 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-946de5c8-1399-4331-9901-983168af2d7b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:34.268486 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-946de5c8-1399-4331-9901-983168af2d7b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:34.269247 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-946de5c8-1399-4331-9901-983168af2d7b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:34.269682 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-946de5c8-1399-4331-9901-983168af2d7b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:34.334023 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-946de5c8-1399-4331-9901-983168af2d7b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:34.342089 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-946de5c8-1399-4331-9901-983168af2d7b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.084472 Jul 19 09:40:34.342645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 680/1387] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:34 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:35.358285 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6eef3f34-b882-4b26-9a12-c08fc4e41307 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:35.358893 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6eef3f34-b882-4b26-9a12-c08fc4e41307 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:35.364720 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6eef3f34-b882-4b26-9a12-c08fc4e41307 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:35.365168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6eef3f34-b882-4b26-9a12-c08fc4e41307 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:35.365960 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6eef3f34-b882-4b26-9a12-c08fc4e41307 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:35.366399 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6eef3f34-b882-4b26-9a12-c08fc4e41307 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:35.425451 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6eef3f34-b882-4b26-9a12-c08fc4e41307 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:35.432962 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6eef3f34-b882-4b26-9a12-c08fc4e41307 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078218 Jul 19 09:40:35.433963 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 708/1388] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:35 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:36.449981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2f26a5e5-0bed-4c51-b34a-3a88b6761134 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:36.450587 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2f26a5e5-0bed-4c51-b34a-3a88b6761134 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:36.456373 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2f26a5e5-0bed-4c51-b34a-3a88b6761134 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:36.456816 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2f26a5e5-0bed-4c51-b34a-3a88b6761134 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:36.457564 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2f26a5e5-0bed-4c51-b34a-3a88b6761134 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:36.457991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2f26a5e5-0bed-4c51-b34a-3a88b6761134 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:36.517573 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2f26a5e5-0bed-4c51-b34a-3a88b6761134 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:36.525139 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2f26a5e5-0bed-4c51-b34a-3a88b6761134 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079413 Jul 19 09:40:36.525696 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 681/1389] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:36 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:37.201251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:40:37.201733 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:40:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:40:37.542473 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5f7c1b98-8157-409c-a9df-af0992d43d21 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:37.543597 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5f7c1b98-8157-409c-a9df-af0992d43d21 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:37.549346 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f7c1b98-8157-409c-a9df-af0992d43d21 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:37.549794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f7c1b98-8157-409c-a9df-af0992d43d21 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:37.550577 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f7c1b98-8157-409c-a9df-af0992d43d21 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:37.551007 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f7c1b98-8157-409c-a9df-af0992d43d21 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:37.610454 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5f7c1b98-8157-409c-a9df-af0992d43d21 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:37.617966 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5f7c1b98-8157-409c-a9df-af0992d43d21 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079433 Jul 19 09:40:37.618514 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 709/1390] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:37 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:38.634004 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9b56a624-3aad-42ce-96d6-f00f14cad59b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:38.634538 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9b56a624-3aad-42ce-96d6-f00f14cad59b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:38.640332 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9b56a624-3aad-42ce-96d6-f00f14cad59b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:38.640779 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9b56a624-3aad-42ce-96d6-f00f14cad59b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:38.641545 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9b56a624-3aad-42ce-96d6-f00f14cad59b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:38.641981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9b56a624-3aad-42ce-96d6-f00f14cad59b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:38.701783 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9b56a624-3aad-42ce-96d6-f00f14cad59b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:38.709315 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9b56a624-3aad-42ce-96d6-f00f14cad59b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079027 Jul 19 09:40:38.709866 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 682/1391] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:38 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:39.725800 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8fafbdb5-4d51-4ca3-9a7d-9edca3a7b724 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:39.726405 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8fafbdb5-4d51-4ca3-9a7d-9edca3a7b724 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:39.732156 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8fafbdb5-4d51-4ca3-9a7d-9edca3a7b724 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:39.732605 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8fafbdb5-4d51-4ca3-9a7d-9edca3a7b724 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:39.733358 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8fafbdb5-4d51-4ca3-9a7d-9edca3a7b724 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:39.733798 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8fafbdb5-4d51-4ca3-9a7d-9edca3a7b724 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:39.793613 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8fafbdb5-4d51-4ca3-9a7d-9edca3a7b724 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:39.801119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8fafbdb5-4d51-4ca3-9a7d-9edca3a7b724 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079117 Jul 19 09:40:39.801679 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 710/1392] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:39 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:40.817998 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8d3f524d-98c4-4404-99cb-479c1f22ebdf tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:40.818538 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8d3f524d-98c4-4404-99cb-479c1f22ebdf tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:40.824270 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8d3f524d-98c4-4404-99cb-479c1f22ebdf tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:40.824714 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8d3f524d-98c4-4404-99cb-479c1f22ebdf tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:40.825961 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8d3f524d-98c4-4404-99cb-479c1f22ebdf tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:40.826396 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8d3f524d-98c4-4404-99cb-479c1f22ebdf tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:40.884478 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8d3f524d-98c4-4404-99cb-479c1f22ebdf tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:40.892393 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8d3f524d-98c4-4404-99cb-479c1f22ebdf tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078057 Jul 19 09:40:40.892952 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 683/1393] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:40 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:41.909281 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5d8fcf08-7d1f-47bc-856c-a4e2dabff2e6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:41.909804 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5d8fcf08-7d1f-47bc-856c-a4e2dabff2e6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:41.915783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5d8fcf08-7d1f-47bc-856c-a4e2dabff2e6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:41.916232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5d8fcf08-7d1f-47bc-856c-a4e2dabff2e6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:41.917013 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5d8fcf08-7d1f-47bc-856c-a4e2dabff2e6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:41.917444 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5d8fcf08-7d1f-47bc-856c-a4e2dabff2e6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:41.986729 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5d8fcf08-7d1f-47bc-856c-a4e2dabff2e6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:41.994325 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5d8fcf08-7d1f-47bc-856c-a4e2dabff2e6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.089290 Jul 19 09:40:41.994875 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 711/1394] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:41 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:43.010594 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ab710bd7-fcf9-43b3-b4ec-cd0478ba64c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:43.011230 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ab710bd7-fcf9-43b3-b4ec-cd0478ba64c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:43.017574 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ab710bd7-fcf9-43b3-b4ec-cd0478ba64c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:43.018020 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ab710bd7-fcf9-43b3-b4ec-cd0478ba64c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:43.018774 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ab710bd7-fcf9-43b3-b4ec-cd0478ba64c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:43.019241 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ab710bd7-fcf9-43b3-b4ec-cd0478ba64c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:43.083099 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ab710bd7-fcf9-43b3-b4ec-cd0478ba64c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:43.096551 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ab710bd7-fcf9-43b3-b4ec-cd0478ba64c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.089492 Jul 19 09:40:43.097170 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 684/1395] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:43 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:44.112676 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1b26f3c2-7606-4d34-8bf1-66df823cc7df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:44.113320 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1b26f3c2-7606-4d34-8bf1-66df823cc7df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:44.119435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b26f3c2-7606-4d34-8bf1-66df823cc7df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:44.119884 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b26f3c2-7606-4d34-8bf1-66df823cc7df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:44.120708 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b26f3c2-7606-4d34-8bf1-66df823cc7df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:44.121161 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b26f3c2-7606-4d34-8bf1-66df823cc7df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:44.182619 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1b26f3c2-7606-4d34-8bf1-66df823cc7df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:44.190828 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1b26f3c2-7606-4d34-8bf1-66df823cc7df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.082104 Jul 19 09:40:44.191415 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 712/1396] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:44 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:45.206961 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ded25984-236f-423f-919c-dfb8ee5ee192 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:45.207729 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ded25984-236f-423f-919c-dfb8ee5ee192 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:45.213431 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ded25984-236f-423f-919c-dfb8ee5ee192 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:45.213949 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ded25984-236f-423f-919c-dfb8ee5ee192 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:45.214777 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ded25984-236f-423f-919c-dfb8ee5ee192 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:45.215307 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ded25984-236f-423f-919c-dfb8ee5ee192 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:45.275725 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ded25984-236f-423f-919c-dfb8ee5ee192 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:45.284013 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ded25984-236f-423f-919c-dfb8ee5ee192 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080672 Jul 19 09:40:45.284580 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 685/1397] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:45 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:46.301329 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f74389ce-8e9c-4aae-bbba-1a601970ba81 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:46.301935 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f74389ce-8e9c-4aae-bbba-1a601970ba81 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:46.307721 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f74389ce-8e9c-4aae-bbba-1a601970ba81 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:46.308172 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f74389ce-8e9c-4aae-bbba-1a601970ba81 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:46.308929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f74389ce-8e9c-4aae-bbba-1a601970ba81 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:46.309362 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f74389ce-8e9c-4aae-bbba-1a601970ba81 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:46.369173 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f74389ce-8e9c-4aae-bbba-1a601970ba81 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:46.377353 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f74389ce-8e9c-4aae-bbba-1a601970ba81 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079648 Jul 19 09:40:46.377918 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 713/1398] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:46 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:47.394089 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ebc5b085-c8d9-4a0a-92a4-12bcbc09fe1e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:47.394775 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ebc5b085-c8d9-4a0a-92a4-12bcbc09fe1e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:47.400526 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ebc5b085-c8d9-4a0a-92a4-12bcbc09fe1e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:47.400963 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ebc5b085-c8d9-4a0a-92a4-12bcbc09fe1e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:47.401760 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ebc5b085-c8d9-4a0a-92a4-12bcbc09fe1e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:47.402270 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ebc5b085-c8d9-4a0a-92a4-12bcbc09fe1e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:47.462572 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ebc5b085-c8d9-4a0a-92a4-12bcbc09fe1e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:47.470659 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ebc5b085-c8d9-4a0a-92a4-12bcbc09fe1e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080796 Jul 19 09:40:47.471312 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 686/1399] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:47 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:48.487257 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5d11d815-ce25-4aeb-82a9-9bfd0ea4ce9d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:48.487799 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5d11d815-ce25-4aeb-82a9-9bfd0ea4ce9d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:48.493686 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5d11d815-ce25-4aeb-82a9-9bfd0ea4ce9d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:48.494131 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5d11d815-ce25-4aeb-82a9-9bfd0ea4ce9d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:48.494879 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5d11d815-ce25-4aeb-82a9-9bfd0ea4ce9d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:48.495331 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5d11d815-ce25-4aeb-82a9-9bfd0ea4ce9d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:48.554910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5d11d815-ce25-4aeb-82a9-9bfd0ea4ce9d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:48.562482 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5d11d815-ce25-4aeb-82a9-9bfd0ea4ce9d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078879 Jul 19 09:40:48.563076 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 714/1400] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:48 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:49.578658 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bfb87c8b-bc64-4e25-88bc-88d7de41be23 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:49.579290 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bfb87c8b-bc64-4e25-88bc-88d7de41be23 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:49.585155 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bfb87c8b-bc64-4e25-88bc-88d7de41be23 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:49.585599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bfb87c8b-bc64-4e25-88bc-88d7de41be23 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:49.586391 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bfb87c8b-bc64-4e25-88bc-88d7de41be23 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:49.586823 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bfb87c8b-bc64-4e25-88bc-88d7de41be23 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:49.650204 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bfb87c8b-bc64-4e25-88bc-88d7de41be23 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:49.658600 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bfb87c8b-bc64-4e25-88bc-88d7de41be23 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.083456 Jul 19 09:40:49.659396 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 687/1401] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:49 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:50.675552 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3fce0be7-9d66-4f50-a6de-eaa14bb9cd12 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:50.676166 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3fce0be7-9d66-4f50-a6de-eaa14bb9cd12 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:50.681887 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3fce0be7-9d66-4f50-a6de-eaa14bb9cd12 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:50.682341 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3fce0be7-9d66-4f50-a6de-eaa14bb9cd12 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:50.683140 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3fce0be7-9d66-4f50-a6de-eaa14bb9cd12 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:50.683579 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3fce0be7-9d66-4f50-a6de-eaa14bb9cd12 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:50.745809 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3fce0be7-9d66-4f50-a6de-eaa14bb9cd12 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:50.753953 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3fce0be7-9d66-4f50-a6de-eaa14bb9cd12 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.082041 Jul 19 09:40:50.754512 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 715/1402] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:50 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:51.769294 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2409d925-ef31-4468-bd4c-cfda3dfbe301 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:51.769984 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2409d925-ef31-4468-bd4c-cfda3dfbe301 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:51.775687 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2409d925-ef31-4468-bd4c-cfda3dfbe301 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:51.776134 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2409d925-ef31-4468-bd4c-cfda3dfbe301 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:51.776894 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2409d925-ef31-4468-bd4c-cfda3dfbe301 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:51.777326 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2409d925-ef31-4468-bd4c-cfda3dfbe301 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:51.837300 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2409d925-ef31-4468-bd4c-cfda3dfbe301 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:51.845181 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2409d925-ef31-4468-bd4c-cfda3dfbe301 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079505 Jul 19 09:40:51.845732 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 688/1403] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:51 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:52.861961 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c1d83662-b0dd-454f-8565-e697d7bb6618 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:52.862566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c1d83662-b0dd-454f-8565-e697d7bb6618 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:52.868296 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1d83662-b0dd-454f-8565-e697d7bb6618 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:52.868744 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1d83662-b0dd-454f-8565-e697d7bb6618 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:52.869496 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1d83662-b0dd-454f-8565-e697d7bb6618 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:52.869927 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1d83662-b0dd-454f-8565-e697d7bb6618 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:52.928905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c1d83662-b0dd-454f-8565-e697d7bb6618 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:52.936868 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c1d83662-b0dd-454f-8565-e697d7bb6618 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078424 Jul 19 09:40:52.937424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 716/1404] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:52 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:53.953572 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-83ca54d1-7a32-4318-be67-238bd5ce55c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:53.954174 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-83ca54d1-7a32-4318-be67-238bd5ce55c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:53.959988 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-83ca54d1-7a32-4318-be67-238bd5ce55c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:53.960436 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-83ca54d1-7a32-4318-be67-238bd5ce55c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:53.961194 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-83ca54d1-7a32-4318-be67-238bd5ce55c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:53.961626 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-83ca54d1-7a32-4318-be67-238bd5ce55c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:54.021212 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-83ca54d1-7a32-4318-be67-238bd5ce55c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:54.034426 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-83ca54d1-7a32-4318-be67-238bd5ce55c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.085031 Jul 19 09:40:54.035171 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 689/1405] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:53 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:55.051079 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f515c2ef-b6cd-4969-be3c-a5d563805700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:55.051688 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f515c2ef-b6cd-4969-be3c-a5d563805700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:55.057357 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f515c2ef-b6cd-4969-be3c-a5d563805700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:55.057799 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f515c2ef-b6cd-4969-be3c-a5d563805700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:55.058548 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f515c2ef-b6cd-4969-be3c-a5d563805700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:55.058983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f515c2ef-b6cd-4969-be3c-a5d563805700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:55.118320 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f515c2ef-b6cd-4969-be3c-a5d563805700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:55.125909 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f515c2ef-b6cd-4969-be3c-a5d563805700 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078437 Jul 19 09:40:55.126686 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 717/1406] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:55 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:56.141939 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-154aec4d-aef7-49ca-9110-2c373fd8c4d0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:56.142468 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-154aec4d-aef7-49ca-9110-2c373fd8c4d0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:56.148366 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-154aec4d-aef7-49ca-9110-2c373fd8c4d0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:56.148817 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-154aec4d-aef7-49ca-9110-2c373fd8c4d0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:56.149586 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-154aec4d-aef7-49ca-9110-2c373fd8c4d0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:56.150214 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-154aec4d-aef7-49ca-9110-2c373fd8c4d0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:56.211320 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-154aec4d-aef7-49ca-9110-2c373fd8c4d0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:56.219650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-154aec4d-aef7-49ca-9110-2c373fd8c4d0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.081411 Jul 19 09:40:56.220222 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 690/1407] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:56 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:57.235871 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f3850691-4516-476a-92af-6950ac7b9361 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:57.236513 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f3850691-4516-476a-92af-6950ac7b9361 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:57.242321 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f3850691-4516-476a-92af-6950ac7b9361 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:57.242771 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f3850691-4516-476a-92af-6950ac7b9361 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:57.243574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f3850691-4516-476a-92af-6950ac7b9361 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:57.244005 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f3850691-4516-476a-92af-6950ac7b9361 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:57.303768 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f3850691-4516-476a-92af-6950ac7b9361 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:57.311829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f3850691-4516-476a-92af-6950ac7b9361 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079034 Jul 19 09:40:57.312388 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 718/1408] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:57 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:40:58.328683 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0ebdc446-099f-4c7c-b2ab-8241747ec9c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:58.329365 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0ebdc446-099f-4c7c-b2ab-8241747ec9c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:58.335204 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0ebdc446-099f-4c7c-b2ab-8241747ec9c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:58.335675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0ebdc446-099f-4c7c-b2ab-8241747ec9c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:58.336424 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0ebdc446-099f-4c7c-b2ab-8241747ec9c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:58.336852 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0ebdc446-099f-4c7c-b2ab-8241747ec9c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:58.399988 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0ebdc446-099f-4c7c-b2ab-8241747ec9c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:58.407564 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0ebdc446-099f-4c7c-b2ab-8241747ec9c9 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.082972 Jul 19 09:40:58.408133 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 691/1409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:58 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:40:59.424172 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-33a03965-6ebb-4bf9-9561-5dc7e937b13c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:40:59.424718 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-33a03965-6ebb-4bf9-9561-5dc7e937b13c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:40:59.430760 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33a03965-6ebb-4bf9-9561-5dc7e937b13c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:59.431243 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33a03965-6ebb-4bf9-9561-5dc7e937b13c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:59.431998 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33a03965-6ebb-4bf9-9561-5dc7e937b13c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:40:59.432431 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33a03965-6ebb-4bf9-9561-5dc7e937b13c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:40:59.495587 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-33a03965-6ebb-4bf9-9561-5dc7e937b13c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:40:59.503480 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-33a03965-6ebb-4bf9-9561-5dc7e937b13c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.083454 Jul 19 09:40:59.504235 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 719/1410] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:40:59 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:00.519967 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a90f59f8-3c1d-4554-bc34-6f1d834a0c3c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:00.520581 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a90f59f8-3c1d-4554-bc34-6f1d834a0c3c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:00.534650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a90f59f8-3c1d-4554-bc34-6f1d834a0c3c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:00.534650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a90f59f8-3c1d-4554-bc34-6f1d834a0c3c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:00.534650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a90f59f8-3c1d-4554-bc34-6f1d834a0c3c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:00.534650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a90f59f8-3c1d-4554-bc34-6f1d834a0c3c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:00.544221 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 09:41:00.591096 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a90f59f8-3c1d-4554-bc34-6f1d834a0c3c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:00.598730 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a90f59f8-3c1d-4554-bc34-6f1d834a0c3c tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.082306 Jul 19 09:41:00.599260 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 692/1411] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:00 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:01.614939 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9416e685-c2b7-4c99-a621-dcc7bef8b239 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:01.615572 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9416e685-c2b7-4c99-a621-dcc7bef8b239 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:01.621257 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9416e685-c2b7-4c99-a621-dcc7bef8b239 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:01.621705 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9416e685-c2b7-4c99-a621-dcc7bef8b239 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:01.622466 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9416e685-c2b7-4c99-a621-dcc7bef8b239 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:01.622902 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9416e685-c2b7-4c99-a621-dcc7bef8b239 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:01.682182 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9416e685-c2b7-4c99-a621-dcc7bef8b239 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:01.690192 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9416e685-c2b7-4c99-a621-dcc7bef8b239 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078871 Jul 19 09:41:01.690752 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 720/1412] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:01 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:02.706709 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-782c125d-4ebf-46dd-9568-3fdb2ba7c0fe tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:02.707390 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-782c125d-4ebf-46dd-9568-3fdb2ba7c0fe tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:02.725221 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-782c125d-4ebf-46dd-9568-3fdb2ba7c0fe tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:02.725668 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-782c125d-4ebf-46dd-9568-3fdb2ba7c0fe tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:02.726432 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-782c125d-4ebf-46dd-9568-3fdb2ba7c0fe tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:02.726861 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-782c125d-4ebf-46dd-9568-3fdb2ba7c0fe tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:02.731804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 58458. Jul 19 09:41:02.787907 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-782c125d-4ebf-46dd-9568-3fdb2ba7c0fe tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:02.795663 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-782c125d-4ebf-46dd-9568-3fdb2ba7c0fe tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.092601 Jul 19 09:41:02.796220 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 693/1413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:02 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:03.144794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-52b2d06b-8ab9-48a9-ac5f-41b73efbb09d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:03.145309 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-52b2d06b-8ab9-48a9-ac5f-41b73efbb09d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:03.151078 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-52b2d06b-8ab9-48a9-ac5f-41b73efbb09d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:03.151531 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-52b2d06b-8ab9-48a9-ac5f-41b73efbb09d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:03.152288 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-52b2d06b-8ab9-48a9-ac5f-41b73efbb09d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:03.152720 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-52b2d06b-8ab9-48a9-ac5f-41b73efbb09d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:03.176612 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-52b2d06b-8ab9-48a9-ac5f-41b73efbb09d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Going to try to terminate instance {{(pid=107463) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:41:03.253872 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-52b2d06b-8ab9-48a9-ac5f-41b73efbb09d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 204 len: 0 microversion: 2.1 time: 0.112244 Jul 19 09:41:03.255395 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 721/1414] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:41:03 2021] DELETE /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 09:41:03.263642 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-53b42e62-676d-4db1-aa95-ace422d90966 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:03.264258 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-53b42e62-676d-4db1-aa95-ace422d90966 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:03.270751 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-53b42e62-676d-4db1-aa95-ace422d90966 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:03.271244 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-53b42e62-676d-4db1-aa95-ace422d90966 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:03.272012 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-53b42e62-676d-4db1-aa95-ace422d90966 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:03.272537 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-53b42e62-676d-4db1-aa95-ace422d90966 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:03.408002 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-53b42e62-676d-4db1-aa95-ace422d90966 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:03.415933 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-53b42e62-676d-4db1-aa95-ace422d90966 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1717 microversion: 2.1 time: 0.156058 Jul 19 09:41:03.416491 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 694/1415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:03 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:03.812519 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-aef885ea-0efb-41cd-8fa7-cb9f93e960ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:03.813213 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-aef885ea-0efb-41cd-8fa7-cb9f93e960ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:03.819011 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aef885ea-0efb-41cd-8fa7-cb9f93e960ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:03.819494 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aef885ea-0efb-41cd-8fa7-cb9f93e960ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:03.820265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aef885ea-0efb-41cd-8fa7-cb9f93e960ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:03.820704 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aef885ea-0efb-41cd-8fa7-cb9f93e960ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:03.880587 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-aef885ea-0efb-41cd-8fa7-cb9f93e960ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:03.888080 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-aef885ea-0efb-41cd-8fa7-cb9f93e960ea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079526 Jul 19 09:41:03.888648 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 722/1416] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:03 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:04.435696 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ab1da933-7d0c-4c50-b692-90b04c8aeaa3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:04.436326 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ab1da933-7d0c-4c50-b692-90b04c8aeaa3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:04.442411 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ab1da933-7d0c-4c50-b692-90b04c8aeaa3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:04.442862 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ab1da933-7d0c-4c50-b692-90b04c8aeaa3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:04.443671 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ab1da933-7d0c-4c50-b692-90b04c8aeaa3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:04.444107 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ab1da933-7d0c-4c50-b692-90b04c8aeaa3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:04.554747 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ab1da933-7d0c-4c50-b692-90b04c8aeaa3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:04.563196 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ab1da933-7d0c-4c50-b692-90b04c8aeaa3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1650 microversion: 2.1 time: 0.131962 Jul 19 09:41:04.573228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 695/1417] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:04 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1650 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:04.774817 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-dba8c96a-f564-4fa2-b89a-7f2bf9131dd2 req-81cada4d-bb3c-4db1-aac1-e12c6e675a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bff3c23-e302-4420-a1fd-58fd8e80c1a1", "name": "network-vif-deleted", "tag": "87db64a6-2a2a-4166-8416-043946cccae6"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:41:04.776610 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:41:04.776610 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:41:04.784847 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-dba8c96a-f564-4fa2-b89a-7f2bf9131dd2 req-81cada4d-bb3c-4db1-aac1-e12c6e675a2c service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:04.785659 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-dba8c96a-f564-4fa2-b89a-7f2bf9131dd2 req-81cada4d-bb3c-4db1-aac1-e12c6e675a2c service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:04.799346 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-dba8c96a-f564-4fa2-b89a-7f2bf9131dd2 req-81cada4d-bb3c-4db1-aac1-e12c6e675a2c service nova] Creating event network-vif-deleted:87db64a6-2a2a-4166-8416-043946cccae6 for instance 5bff3c23-e302-4420-a1fd-58fd8e80c1a1 on hv-cinder-79338 Jul 19 09:41:04.813395 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-dba8c96a-f564-4fa2-b89a-7f2bf9131dd2 req-81cada4d-bb3c-4db1-aac1-e12c6e675a2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033575 Jul 19 09:41:04.814664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 723/1418] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:41:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:41:04.903844 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-470f0a6d-ffe3-40c4-946b-adca5cfe6976 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:04.904600 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-470f0a6d-ffe3-40c4-946b-adca5cfe6976 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:04.911118 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-470f0a6d-ffe3-40c4-946b-adca5cfe6976 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:04.911684 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-470f0a6d-ffe3-40c4-946b-adca5cfe6976 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:04.912580 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-470f0a6d-ffe3-40c4-946b-adca5cfe6976 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:04.913107 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-470f0a6d-ffe3-40c4-946b-adca5cfe6976 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:04.976903 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-470f0a6d-ffe3-40c4-946b-adca5cfe6976 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:04.985937 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-470f0a6d-ffe3-40c4-946b-adca5cfe6976 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.085179 Jul 19 09:41:04.986506 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 696/1419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:04 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:05.581115 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0c2751b1-b1e5-43ce-828d-31c0aee2f219 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:05.581897 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0c2751b1-b1e5-43ce-828d-31c0aee2f219 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:05.588066 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0c2751b1-b1e5-43ce-828d-31c0aee2f219 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:05.588589 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0c2751b1-b1e5-43ce-828d-31c0aee2f219 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:05.589357 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0c2751b1-b1e5-43ce-828d-31c0aee2f219 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:05.589781 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0c2751b1-b1e5-43ce-828d-31c0aee2f219 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:05.653690 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0c2751b1-b1e5-43ce-828d-31c0aee2f219 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:05.662205 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0c2751b1-b1e5-43ce-828d-31c0aee2f219 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.085526 Jul 19 09:41:05.662773 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 724/1420] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:05 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:06.003955 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-64438898-06eb-45b2-b664-f5f596bad8ec tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:06.004597 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-64438898-06eb-45b2-b664-f5f596bad8ec tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:06.010372 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-64438898-06eb-45b2-b664-f5f596bad8ec tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:06.010820 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-64438898-06eb-45b2-b664-f5f596bad8ec tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:06.011613 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-64438898-06eb-45b2-b664-f5f596bad8ec tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:06.012049 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-64438898-06eb-45b2-b664-f5f596bad8ec tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:06.073078 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-64438898-06eb-45b2-b664-f5f596bad8ec tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:06.083309 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-64438898-06eb-45b2-b664-f5f596bad8ec tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.082994 Jul 19 09:41:06.084014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 697/1421] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:05 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:06.678680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-af12b9f0-0233-41b4-9ab4-195329ba60a1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:06.679315 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-af12b9f0-0233-41b4-9ab4-195329ba60a1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:06.685056 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-af12b9f0-0233-41b4-9ab4-195329ba60a1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:06.685500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-af12b9f0-0233-41b4-9ab4-195329ba60a1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:06.686260 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-af12b9f0-0233-41b4-9ab4-195329ba60a1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:06.686680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-af12b9f0-0233-41b4-9ab4-195329ba60a1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:06.748773 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-af12b9f0-0233-41b4-9ab4-195329ba60a1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:06.756413 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-af12b9f0-0233-41b4-9ab4-195329ba60a1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081361 Jul 19 09:41:06.756973 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 725/1422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:06 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:07.100507 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b3dffb9b-cb0c-4470-b2ea-3822a223ecd8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:07.101063 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b3dffb9b-cb0c-4470-b2ea-3822a223ecd8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:07.106841 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b3dffb9b-cb0c-4470-b2ea-3822a223ecd8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:07.107385 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b3dffb9b-cb0c-4470-b2ea-3822a223ecd8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:07.108151 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b3dffb9b-cb0c-4470-b2ea-3822a223ecd8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:07.108588 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b3dffb9b-cb0c-4470-b2ea-3822a223ecd8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:07.169046 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b3dffb9b-cb0c-4470-b2ea-3822a223ecd8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:07.176816 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b3dffb9b-cb0c-4470-b2ea-3822a223ecd8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080062 Jul 19 09:41:07.177376 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 698/1423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:07 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:07.772167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9abba950-db28-4a0f-a509-0517ec41d787 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:07.772767 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9abba950-db28-4a0f-a509-0517ec41d787 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:07.778542 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9abba950-db28-4a0f-a509-0517ec41d787 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:07.778984 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9abba950-db28-4a0f-a509-0517ec41d787 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:07.779762 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9abba950-db28-4a0f-a509-0517ec41d787 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:07.780186 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9abba950-db28-4a0f-a509-0517ec41d787 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:07.839013 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9abba950-db28-4a0f-a509-0517ec41d787 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:07.846393 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9abba950-db28-4a0f-a509-0517ec41d787 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078119 Jul 19 09:41:07.846945 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 726/1424] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:07 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:08.193403 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-01079c5b-b17c-414d-8720-091ca099c451 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:08.194008 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-01079c5b-b17c-414d-8720-091ca099c451 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:08.199776 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-01079c5b-b17c-414d-8720-091ca099c451 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:08.200217 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-01079c5b-b17c-414d-8720-091ca099c451 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:08.200964 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-01079c5b-b17c-414d-8720-091ca099c451 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:08.201391 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-01079c5b-b17c-414d-8720-091ca099c451 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:08.263406 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-01079c5b-b17c-414d-8720-091ca099c451 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:08.270859 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-01079c5b-b17c-414d-8720-091ca099c451 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.081063 Jul 19 09:41:08.271439 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 699/1425] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:08 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:08.862016 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-04d8fb2c-cd43-47fd-b1df-558c5731b07e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:08.862655 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-04d8fb2c-cd43-47fd-b1df-558c5731b07e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:08.868397 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-04d8fb2c-cd43-47fd-b1df-558c5731b07e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:08.868839 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-04d8fb2c-cd43-47fd-b1df-558c5731b07e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:08.869590 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-04d8fb2c-cd43-47fd-b1df-558c5731b07e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:08.870023 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-04d8fb2c-cd43-47fd-b1df-558c5731b07e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:08.929119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-04d8fb2c-cd43-47fd-b1df-558c5731b07e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:08.937068 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-04d8fb2c-cd43-47fd-b1df-558c5731b07e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078673 Jul 19 09:41:08.937619 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 727/1426] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:08 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:09.287733 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-62ee33a5-7ec6-4fcb-86b7-13d9439d2d47 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:09.288341 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-62ee33a5-7ec6-4fcb-86b7-13d9439d2d47 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:09.294313 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-62ee33a5-7ec6-4fcb-86b7-13d9439d2d47 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:09.294760 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-62ee33a5-7ec6-4fcb-86b7-13d9439d2d47 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:09.296055 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-62ee33a5-7ec6-4fcb-86b7-13d9439d2d47 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:09.296487 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-62ee33a5-7ec6-4fcb-86b7-13d9439d2d47 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:09.354615 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-62ee33a5-7ec6-4fcb-86b7-13d9439d2d47 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:09.362601 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-62ee33a5-7ec6-4fcb-86b7-13d9439d2d47 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078516 Jul 19 09:41:09.363197 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 700/1427] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:09 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:09.952968 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ebfd6223-cd08-4075-9c6c-a8f003b7d6f5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:09.953570 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ebfd6223-cd08-4075-9c6c-a8f003b7d6f5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:09.959300 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ebfd6223-cd08-4075-9c6c-a8f003b7d6f5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:09.959742 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ebfd6223-cd08-4075-9c6c-a8f003b7d6f5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:09.960497 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ebfd6223-cd08-4075-9c6c-a8f003b7d6f5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:09.960923 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ebfd6223-cd08-4075-9c6c-a8f003b7d6f5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:10.020575 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ebfd6223-cd08-4075-9c6c-a8f003b7d6f5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:10.027960 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ebfd6223-cd08-4075-9c6c-a8f003b7d6f5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078619 Jul 19 09:41:10.028510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 728/1428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:09 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:10.379475 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ba2c5796-4d23-446b-a004-e9c172cea74d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:10.380080 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ba2c5796-4d23-446b-a004-e9c172cea74d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:10.385851 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba2c5796-4d23-446b-a004-e9c172cea74d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:10.386290 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba2c5796-4d23-446b-a004-e9c172cea74d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:10.387065 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba2c5796-4d23-446b-a004-e9c172cea74d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:10.387484 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba2c5796-4d23-446b-a004-e9c172cea74d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:10.448010 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ba2c5796-4d23-446b-a004-e9c172cea74d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:10.456138 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ba2c5796-4d23-446b-a004-e9c172cea74d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080339 Jul 19 09:41:10.456688 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 701/1429] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:10 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:11.045134 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8700db24-95e4-4925-b8e1-f352b6ffb20c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:11.045784 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8700db24-95e4-4925-b8e1-f352b6ffb20c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:11.052242 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8700db24-95e4-4925-b8e1-f352b6ffb20c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:11.052696 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8700db24-95e4-4925-b8e1-f352b6ffb20c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:11.053461 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8700db24-95e4-4925-b8e1-f352b6ffb20c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:11.053895 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8700db24-95e4-4925-b8e1-f352b6ffb20c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:11.115797 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8700db24-95e4-4925-b8e1-f352b6ffb20c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:11.123424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8700db24-95e4-4925-b8e1-f352b6ffb20c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081950 Jul 19 09:41:11.123987 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 729/1430] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:11 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:11.472123 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8ce38f7d-7442-45a9-a3c6-fb001dda1bea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:11.472739 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8ce38f7d-7442-45a9-a3c6-fb001dda1bea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:11.478517 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8ce38f7d-7442-45a9-a3c6-fb001dda1bea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:11.478969 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8ce38f7d-7442-45a9-a3c6-fb001dda1bea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:11.479784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8ce38f7d-7442-45a9-a3c6-fb001dda1bea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:11.480254 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8ce38f7d-7442-45a9-a3c6-fb001dda1bea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:11.540796 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8ce38f7d-7442-45a9-a3c6-fb001dda1bea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:11.548399 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8ce38f7d-7442-45a9-a3c6-fb001dda1bea tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080435 Jul 19 09:41:11.548958 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 702/1431] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:11 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:12.141105 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-707f5936-98f0-4700-bc09-d93fc9a15cd0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:12.141798 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-707f5936-98f0-4700-bc09-d93fc9a15cd0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:12.147583 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-707f5936-98f0-4700-bc09-d93fc9a15cd0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:12.148038 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-707f5936-98f0-4700-bc09-d93fc9a15cd0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:12.148805 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-707f5936-98f0-4700-bc09-d93fc9a15cd0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:12.149252 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-707f5936-98f0-4700-bc09-d93fc9a15cd0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:12.209662 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-707f5936-98f0-4700-bc09-d93fc9a15cd0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:12.217293 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-707f5936-98f0-4700-bc09-d93fc9a15cd0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.080451 Jul 19 09:41:12.217847 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 730/1432] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:12 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:12.565422 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a042cd10-e388-442b-8a7b-0ec206550099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:12.566033 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a042cd10-e388-442b-8a7b-0ec206550099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:12.571792 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a042cd10-e388-442b-8a7b-0ec206550099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:12.572236 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a042cd10-e388-442b-8a7b-0ec206550099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:12.572993 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a042cd10-e388-442b-8a7b-0ec206550099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:12.573424 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a042cd10-e388-442b-8a7b-0ec206550099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:12.636138 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a042cd10-e388-442b-8a7b-0ec206550099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:12.643712 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a042cd10-e388-442b-8a7b-0ec206550099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.082573 Jul 19 09:41:12.644271 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 703/1433] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:12 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:13.233629 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a16d1368-ad3e-48b1-a5a2-65d7571bbbda tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:13.234249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a16d1368-ad3e-48b1-a5a2-65d7571bbbda tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:13.240079 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a16d1368-ad3e-48b1-a5a2-65d7571bbbda tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:13.240537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a16d1368-ad3e-48b1-a5a2-65d7571bbbda tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:13.241286 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a16d1368-ad3e-48b1-a5a2-65d7571bbbda tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:13.241717 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a16d1368-ad3e-48b1-a5a2-65d7571bbbda tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:13.398515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a16d1368-ad3e-48b1-a5a2-65d7571bbbda tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:13.406225 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a16d1368-ad3e-48b1-a5a2-65d7571bbbda tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.176215 Jul 19 09:41:13.406792 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 731/1434] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:13 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:13.660212 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cca80371-d193-4dbd-8a81-bb1dd850a5c8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:13.660745 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cca80371-d193-4dbd-8a81-bb1dd850a5c8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:13.666709 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cca80371-d193-4dbd-8a81-bb1dd850a5c8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:13.667196 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cca80371-d193-4dbd-8a81-bb1dd850a5c8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:13.667955 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cca80371-d193-4dbd-8a81-bb1dd850a5c8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:13.668387 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cca80371-d193-4dbd-8a81-bb1dd850a5c8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:13.727002 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cca80371-d193-4dbd-8a81-bb1dd850a5c8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:13.735077 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cca80371-d193-4dbd-8a81-bb1dd850a5c8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078570 Jul 19 09:41:13.735629 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 704/1435] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:13 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:14.423094 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-fde8d953-28ad-44b9-86e7-a47fd61c6ffc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:14.423689 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-fde8d953-28ad-44b9-86e7-a47fd61c6ffc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:14.429672 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fde8d953-28ad-44b9-86e7-a47fd61c6ffc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:14.430123 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fde8d953-28ad-44b9-86e7-a47fd61c6ffc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:14.430892 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fde8d953-28ad-44b9-86e7-a47fd61c6ffc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:14.431343 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fde8d953-28ad-44b9-86e7-a47fd61c6ffc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:14.490624 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-fde8d953-28ad-44b9-86e7-a47fd61c6ffc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:14.498073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-fde8d953-28ad-44b9-86e7-a47fd61c6ffc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078721 Jul 19 09:41:14.498630 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 732/1436] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:14 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:14.853382 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-85ce5f6e-b624-437b-823c-f70842397093 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:14.853990 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-85ce5f6e-b624-437b-823c-f70842397093 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:14.860077 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-85ce5f6e-b624-437b-823c-f70842397093 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:14.860513 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-85ce5f6e-b624-437b-823c-f70842397093 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:14.861261 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-85ce5f6e-b624-437b-823c-f70842397093 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:14.861686 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-85ce5f6e-b624-437b-823c-f70842397093 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:14.920736 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-85ce5f6e-b624-437b-823c-f70842397093 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:14.928820 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-85ce5f6e-b624-437b-823c-f70842397093 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.181144 Jul 19 09:41:14.929377 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 705/1437] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:14 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:15.514777 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e23e35ca-2d98-417d-9c46-eaf2dceda34d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:15.515856 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e23e35ca-2d98-417d-9c46-eaf2dceda34d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:15.521671 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e23e35ca-2d98-417d-9c46-eaf2dceda34d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:15.522122 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e23e35ca-2d98-417d-9c46-eaf2dceda34d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:15.522875 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e23e35ca-2d98-417d-9c46-eaf2dceda34d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:15.523336 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e23e35ca-2d98-417d-9c46-eaf2dceda34d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:15.585825 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e23e35ca-2d98-417d-9c46-eaf2dceda34d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:15.593860 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e23e35ca-2d98-417d-9c46-eaf2dceda34d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.082291 Jul 19 09:41:15.594417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 733/1438] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:15 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:15.945480 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-945e8737-fb37-4289-a0f5-696ca2d74699 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:15.946081 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-945e8737-fb37-4289-a0f5-696ca2d74699 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:15.952067 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-945e8737-fb37-4289-a0f5-696ca2d74699 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:15.952558 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-945e8737-fb37-4289-a0f5-696ca2d74699 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:15.953861 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-945e8737-fb37-4289-a0f5-696ca2d74699 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:15.954284 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-945e8737-fb37-4289-a0f5-696ca2d74699 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:16.013838 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-945e8737-fb37-4289-a0f5-696ca2d74699 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:16.021347 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-945e8737-fb37-4289-a0f5-696ca2d74699 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079732 Jul 19 09:41:16.021898 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 706/1439] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:15 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:16.610809 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ed5e932d-6cd1-4929-9198-f60c1124210f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:16.611444 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ed5e932d-6cd1-4929-9198-f60c1124210f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:16.617198 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ed5e932d-6cd1-4929-9198-f60c1124210f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:16.617646 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ed5e932d-6cd1-4929-9198-f60c1124210f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:16.618391 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ed5e932d-6cd1-4929-9198-f60c1124210f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:16.618818 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ed5e932d-6cd1-4929-9198-f60c1124210f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:16.678403 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ed5e932d-6cd1-4929-9198-f60c1124210f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:16.685866 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ed5e932d-6cd1-4929-9198-f60c1124210f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079360 Jul 19 09:41:16.686419 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 734/1440] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:16 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:17.037678 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-413c556a-8429-443a-9cbc-83fd3fcbb488 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:17.038219 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-413c556a-8429-443a-9cbc-83fd3fcbb488 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:17.044282 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-413c556a-8429-443a-9cbc-83fd3fcbb488 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:17.044732 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-413c556a-8429-443a-9cbc-83fd3fcbb488 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:17.045498 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-413c556a-8429-443a-9cbc-83fd3fcbb488 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:17.045935 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-413c556a-8429-443a-9cbc-83fd3fcbb488 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:17.108166 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-413c556a-8429-443a-9cbc-83fd3fcbb488 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:17.115663 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-413c556a-8429-443a-9cbc-83fd3fcbb488 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.081749 Jul 19 09:41:17.116219 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 707/1441] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:17 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:17.701233 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-14aa8745-770a-4d7a-b825-1271bd1ebd65 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:17.701836 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-14aa8745-770a-4d7a-b825-1271bd1ebd65 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:17.707570 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14aa8745-770a-4d7a-b825-1271bd1ebd65 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:17.708010 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14aa8745-770a-4d7a-b825-1271bd1ebd65 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:17.708759 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14aa8745-770a-4d7a-b825-1271bd1ebd65 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:17.709180 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-14aa8745-770a-4d7a-b825-1271bd1ebd65 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:17.767802 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-14aa8745-770a-4d7a-b825-1271bd1ebd65 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:17.775196 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-14aa8745-770a-4d7a-b825-1271bd1ebd65 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.077558 Jul 19 09:41:17.775748 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 735/1442] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:17 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:18.132470 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4b114872-c620-4fb7-8252-4fee0f9a47df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:18.133428 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4b114872-c620-4fb7-8252-4fee0f9a47df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:18.138846 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4b114872-c620-4fb7-8252-4fee0f9a47df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:18.139318 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4b114872-c620-4fb7-8252-4fee0f9a47df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:18.140088 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4b114872-c620-4fb7-8252-4fee0f9a47df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:18.140517 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4b114872-c620-4fb7-8252-4fee0f9a47df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:18.200079 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4b114872-c620-4fb7-8252-4fee0f9a47df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:18.207710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4b114872-c620-4fb7-8252-4fee0f9a47df tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079121 Jul 19 09:41:18.208266 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 708/1443] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:18 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:18.791922 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6d3baadd-60bd-497b-aabd-5dee00a50368 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:18.792530 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6d3baadd-60bd-497b-aabd-5dee00a50368 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:18.798306 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6d3baadd-60bd-497b-aabd-5dee00a50368 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:18.798755 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6d3baadd-60bd-497b-aabd-5dee00a50368 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:18.799537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6d3baadd-60bd-497b-aabd-5dee00a50368 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:18.799970 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6d3baadd-60bd-497b-aabd-5dee00a50368 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:18.858282 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6d3baadd-60bd-497b-aabd-5dee00a50368 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:18.865779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6d3baadd-60bd-497b-aabd-5dee00a50368 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.077933 Jul 19 09:41:18.866333 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 736/1444] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:18 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:19.224890 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e2021417-6f17-4b5d-8895-81903dc13767 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:19.225497 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e2021417-6f17-4b5d-8895-81903dc13767 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:19.231336 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e2021417-6f17-4b5d-8895-81903dc13767 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:19.231785 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e2021417-6f17-4b5d-8895-81903dc13767 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:19.232544 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e2021417-6f17-4b5d-8895-81903dc13767 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:19.232977 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e2021417-6f17-4b5d-8895-81903dc13767 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:19.292205 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e2021417-6f17-4b5d-8895-81903dc13767 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:19.299660 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e2021417-6f17-4b5d-8895-81903dc13767 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078421 Jul 19 09:41:19.300220 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 709/1445] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:19 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:19.882586 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4dac7221-f386-4854-b7c2-46fbd838ecee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:19.883201 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4dac7221-f386-4854-b7c2-46fbd838ecee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:19.888994 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4dac7221-f386-4854-b7c2-46fbd838ecee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:19.889437 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4dac7221-f386-4854-b7c2-46fbd838ecee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:19.890186 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4dac7221-f386-4854-b7c2-46fbd838ecee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:19.890889 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4dac7221-f386-4854-b7c2-46fbd838ecee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:19.953078 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4dac7221-f386-4854-b7c2-46fbd838ecee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:19.960558 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4dac7221-f386-4854-b7c2-46fbd838ecee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081594 Jul 19 09:41:19.961108 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 737/1446] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:19 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:20.315925 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-72e0a619-adc3-4f3e-b35b-b28c4f140f15 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:20.316530 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-72e0a619-adc3-4f3e-b35b-b28c4f140f15 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:20.322295 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72e0a619-adc3-4f3e-b35b-b28c4f140f15 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:20.322740 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72e0a619-adc3-4f3e-b35b-b28c4f140f15 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:20.323532 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72e0a619-adc3-4f3e-b35b-b28c4f140f15 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:20.323964 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72e0a619-adc3-4f3e-b35b-b28c4f140f15 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:20.383409 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-72e0a619-adc3-4f3e-b35b-b28c4f140f15 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:20.390982 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-72e0a619-adc3-4f3e-b35b-b28c4f140f15 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078711 Jul 19 09:41:20.391565 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 710/1447] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:20 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:20.976541 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a61fe44c-e389-4189-822c-b48cfe8d3043 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:20.977150 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a61fe44c-e389-4189-822c-b48cfe8d3043 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:20.982891 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a61fe44c-e389-4189-822c-b48cfe8d3043 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:20.983395 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a61fe44c-e389-4189-822c-b48cfe8d3043 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:20.984151 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a61fe44c-e389-4189-822c-b48cfe8d3043 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:20.984612 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a61fe44c-e389-4189-822c-b48cfe8d3043 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:21.044060 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a61fe44c-e389-4189-822c-b48cfe8d3043 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:21.051498 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a61fe44c-e389-4189-822c-b48cfe8d3043 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078593 Jul 19 09:41:21.052059 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 738/1448] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:20 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:21.407625 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a3c0ffe2-cd2f-417d-8e8f-7a8e7e556ea0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:21.408174 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a3c0ffe2-cd2f-417d-8e8f-7a8e7e556ea0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:21.413899 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a3c0ffe2-cd2f-417d-8e8f-7a8e7e556ea0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:21.414606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a3c0ffe2-cd2f-417d-8e8f-7a8e7e556ea0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:21.415403 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a3c0ffe2-cd2f-417d-8e8f-7a8e7e556ea0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:21.415841 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a3c0ffe2-cd2f-417d-8e8f-7a8e7e556ea0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:21.477790 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a3c0ffe2-cd2f-417d-8e8f-7a8e7e556ea0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:21.485789 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a3c0ffe2-cd2f-417d-8e8f-7a8e7e556ea0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.081984 Jul 19 09:41:21.486346 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 711/1449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:21 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:22.067848 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9de88254-b4f5-4dc5-b7e3-091803fe8d7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:22.068486 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9de88254-b4f5-4dc5-b7e3-091803fe8d7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:22.074373 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9de88254-b4f5-4dc5-b7e3-091803fe8d7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:22.074829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9de88254-b4f5-4dc5-b7e3-091803fe8d7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:22.075639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9de88254-b4f5-4dc5-b7e3-091803fe8d7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:22.076077 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9de88254-b4f5-4dc5-b7e3-091803fe8d7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:22.143208 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9de88254-b4f5-4dc5-b7e3-091803fe8d7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:22.151057 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9de88254-b4f5-4dc5-b7e3-091803fe8d7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.086869 Jul 19 09:41:22.151615 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 739/1450] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:22 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:22.502460 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-715e0446-2117-4725-960a-7b9ac018caef tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:22.503090 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-715e0446-2117-4725-960a-7b9ac018caef tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:22.508800 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-715e0446-2117-4725-960a-7b9ac018caef tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:22.509240 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-715e0446-2117-4725-960a-7b9ac018caef tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:22.509989 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-715e0446-2117-4725-960a-7b9ac018caef tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:22.510415 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-715e0446-2117-4725-960a-7b9ac018caef tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:22.570465 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-715e0446-2117-4725-960a-7b9ac018caef tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:22.578638 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-715e0446-2117-4725-960a-7b9ac018caef tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080344 Jul 19 09:41:22.579224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 712/1451] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:22 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:23.168297 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-235f41fc-ad6d-4c13-b860-0fe729798c5e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:23.168931 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-235f41fc-ad6d-4c13-b860-0fe729798c5e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:23.175295 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-235f41fc-ad6d-4c13-b860-0fe729798c5e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:23.175739 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-235f41fc-ad6d-4c13-b860-0fe729798c5e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:23.176527 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-235f41fc-ad6d-4c13-b860-0fe729798c5e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:23.176951 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-235f41fc-ad6d-4c13-b860-0fe729798c5e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:23.235636 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-235f41fc-ad6d-4c13-b860-0fe729798c5e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:23.243043 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-235f41fc-ad6d-4c13-b860-0fe729798c5e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078675 Jul 19 09:41:23.243602 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 740/1452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:23 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:23.595382 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e1878f91-6725-4a7e-bab9-dd3639d193be tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:23.595955 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e1878f91-6725-4a7e-bab9-dd3639d193be tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:23.601670 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e1878f91-6725-4a7e-bab9-dd3639d193be tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:23.602112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e1878f91-6725-4a7e-bab9-dd3639d193be tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:23.602870 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e1878f91-6725-4a7e-bab9-dd3639d193be tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:23.603321 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e1878f91-6725-4a7e-bab9-dd3639d193be tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:23.662051 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e1878f91-6725-4a7e-bab9-dd3639d193be tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:23.670074 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e1878f91-6725-4a7e-bab9-dd3639d193be tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078915 Jul 19 09:41:23.670637 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 713/1453] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:23 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:24.259659 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-088ea2b3-7a96-4987-8e20-ec84db2b2415 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:24.260250 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-088ea2b3-7a96-4987-8e20-ec84db2b2415 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:24.266450 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-088ea2b3-7a96-4987-8e20-ec84db2b2415 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:24.266900 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-088ea2b3-7a96-4987-8e20-ec84db2b2415 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:24.267696 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-088ea2b3-7a96-4987-8e20-ec84db2b2415 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:24.268132 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-088ea2b3-7a96-4987-8e20-ec84db2b2415 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:24.337407 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-088ea2b3-7a96-4987-8e20-ec84db2b2415 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:24.346766 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-088ea2b3-7a96-4987-8e20-ec84db2b2415 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.090773 Jul 19 09:41:24.347370 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 741/1454] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:24 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:24.687632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-50c3f564-66a9-4be4-870c-6f0b18d84962 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:24.688471 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-50c3f564-66a9-4be4-870c-6f0b18d84962 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:24.695481 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50c3f564-66a9-4be4-870c-6f0b18d84962 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:24.695931 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50c3f564-66a9-4be4-870c-6f0b18d84962 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:24.696941 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50c3f564-66a9-4be4-870c-6f0b18d84962 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:24.697679 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-50c3f564-66a9-4be4-870c-6f0b18d84962 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:24.759856 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-50c3f564-66a9-4be4-870c-6f0b18d84962 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:24.768442 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-50c3f564-66a9-4be4-870c-6f0b18d84962 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.085453 Jul 19 09:41:24.769013 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 714/1455] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:24 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:25.363389 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b59a1e58-2fac-494b-97eb-7e659e3f4117 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:25.363999 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b59a1e58-2fac-494b-97eb-7e659e3f4117 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:25.370084 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b59a1e58-2fac-494b-97eb-7e659e3f4117 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:25.370536 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b59a1e58-2fac-494b-97eb-7e659e3f4117 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:25.371321 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b59a1e58-2fac-494b-97eb-7e659e3f4117 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:25.371756 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b59a1e58-2fac-494b-97eb-7e659e3f4117 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:25.431527 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b59a1e58-2fac-494b-97eb-7e659e3f4117 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:25.439492 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b59a1e58-2fac-494b-97eb-7e659e3f4117 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079742 Jul 19 09:41:25.440048 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 742/1456] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:25 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:25.785702 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e43b4642-3902-463d-99b4-95281e3199dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:25.786247 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e43b4642-3902-463d-99b4-95281e3199dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:25.792275 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e43b4642-3902-463d-99b4-95281e3199dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:25.792723 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e43b4642-3902-463d-99b4-95281e3199dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:25.793481 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e43b4642-3902-463d-99b4-95281e3199dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:25.793915 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e43b4642-3902-463d-99b4-95281e3199dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:25.857552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e43b4642-3902-463d-99b4-95281e3199dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:25.865094 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e43b4642-3902-463d-99b4-95281e3199dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.083154 Jul 19 09:41:25.865821 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 715/1457] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:25 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:26.456380 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5922c852-de1c-463d-a660-4ca3309f9e78 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:26.456934 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5922c852-de1c-463d-a660-4ca3309f9e78 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:26.462905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5922c852-de1c-463d-a660-4ca3309f9e78 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:26.463388 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5922c852-de1c-463d-a660-4ca3309f9e78 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:26.464319 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5922c852-de1c-463d-a660-4ca3309f9e78 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:26.464617 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5922c852-de1c-463d-a660-4ca3309f9e78 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:26.524207 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5922c852-de1c-463d-a660-4ca3309f9e78 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:26.531646 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5922c852-de1c-463d-a660-4ca3309f9e78 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079497 Jul 19 09:41:26.532203 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 743/1458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:26 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:26.882574 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8834172f-6ca5-4864-b69c-0c70c75f7bd2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:26.883224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8834172f-6ca5-4864-b69c-0c70c75f7bd2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:26.889026 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8834172f-6ca5-4864-b69c-0c70c75f7bd2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:26.889470 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8834172f-6ca5-4864-b69c-0c70c75f7bd2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:26.890884 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8834172f-6ca5-4864-b69c-0c70c75f7bd2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:26.891345 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8834172f-6ca5-4864-b69c-0c70c75f7bd2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:26.953379 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8834172f-6ca5-4864-b69c-0c70c75f7bd2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:26.961442 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8834172f-6ca5-4864-b69c-0c70c75f7bd2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.083120 Jul 19 09:41:26.962004 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 716/1459] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:26 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:27.548417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1fea711d-4fb5-41bb-b0f3-0e1cb303c347 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:27.548972 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1fea711d-4fb5-41bb-b0f3-0e1cb303c347 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:27.554847 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1fea711d-4fb5-41bb-b0f3-0e1cb303c347 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:27.555324 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1fea711d-4fb5-41bb-b0f3-0e1cb303c347 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:27.556084 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1fea711d-4fb5-41bb-b0f3-0e1cb303c347 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:27.556518 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1fea711d-4fb5-41bb-b0f3-0e1cb303c347 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:27.615395 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1fea711d-4fb5-41bb-b0f3-0e1cb303c347 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:27.622970 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1fea711d-4fb5-41bb-b0f3-0e1cb303c347 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078308 Jul 19 09:41:27.623566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 744/1460] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:27 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:41:27.979479 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5373c8b5-20b9-4d46-bec4-ab5018c4ca53 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:27.980080 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5373c8b5-20b9-4d46-bec4-ab5018c4ca53 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:27.986376 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5373c8b5-20b9-4d46-bec4-ab5018c4ca53 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:27.986817 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5373c8b5-20b9-4d46-bec4-ab5018c4ca53 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:27.987599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5373c8b5-20b9-4d46-bec4-ab5018c4ca53 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:27.988026 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5373c8b5-20b9-4d46-bec4-ab5018c4ca53 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:28.047218 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5373c8b5-20b9-4d46-bec4-ab5018c4ca53 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:28.054934 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5373c8b5-20b9-4d46-bec4-ab5018c4ca53 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079147 Jul 19 09:41:28.055517 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 717/1461] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:27 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:28.639704 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0a206211-8556-40b2-bb4d-44df58eb45c4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:28.640327 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0a206211-8556-40b2-bb4d-44df58eb45c4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:28.646741 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a206211-8556-40b2-bb4d-44df58eb45c4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:28.647216 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a206211-8556-40b2-bb4d-44df58eb45c4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:28.647966 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a206211-8556-40b2-bb4d-44df58eb45c4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:28.648400 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0a206211-8556-40b2-bb4d-44df58eb45c4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:28.710255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0a206211-8556-40b2-bb4d-44df58eb45c4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:28.717822 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0a206211-8556-40b2-bb4d-44df58eb45c4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081781 Jul 19 09:41:28.718386 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 745/1462] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:28 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:29.071357 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7b629d6a-637a-4624-8b6e-d2c96c81c412 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:29.071874 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7b629d6a-637a-4624-8b6e-d2c96c81c412 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:29.077599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b629d6a-637a-4624-8b6e-d2c96c81c412 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:29.078041 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b629d6a-637a-4624-8b6e-d2c96c81c412 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:29.079356 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b629d6a-637a-4624-8b6e-d2c96c81c412 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:29.079787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b629d6a-637a-4624-8b6e-d2c96c81c412 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:29.138823 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7b629d6a-637a-4624-8b6e-d2c96c81c412 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:29.147141 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7b629d6a-637a-4624-8b6e-d2c96c81c412 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079552 Jul 19 09:41:29.147694 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 718/1463] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:29 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:29.734770 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-970a30b2-086f-4fe4-b4f4-5c4a9cb736c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:29.735412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-970a30b2-086f-4fe4-b4f4-5c4a9cb736c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:29.741183 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-970a30b2-086f-4fe4-b4f4-5c4a9cb736c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:29.741633 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-970a30b2-086f-4fe4-b4f4-5c4a9cb736c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:29.742390 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-970a30b2-086f-4fe4-b4f4-5c4a9cb736c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:29.742824 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-970a30b2-086f-4fe4-b4f4-5c4a9cb736c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:30.014481 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-970a30b2-086f-4fe4-b4f4-5c4a9cb736c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:30.022311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-970a30b2-086f-4fe4-b4f4-5c4a9cb736c2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.291686 Jul 19 09:41:30.022876 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 746/1464] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:29 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:30.163211 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f1b66e89-b685-4e4b-8096-f1cdba02ea2e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:30.163822 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f1b66e89-b685-4e4b-8096-f1cdba02ea2e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:30.170139 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f1b66e89-b685-4e4b-8096-f1cdba02ea2e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:30.170592 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f1b66e89-b685-4e4b-8096-f1cdba02ea2e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:30.171406 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f1b66e89-b685-4e4b-8096-f1cdba02ea2e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:30.171847 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f1b66e89-b685-4e4b-8096-f1cdba02ea2e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:30.235995 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f1b66e89-b685-4e4b-8096-f1cdba02ea2e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:30.243802 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f1b66e89-b685-4e4b-8096-f1cdba02ea2e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.084327 Jul 19 09:41:30.244366 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 719/1465] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:30 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:31.039641 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1a57e816-fe97-4551-83ca-9ff8ee2fc65c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:31.040268 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1a57e816-fe97-4551-83ca-9ff8ee2fc65c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:31.046047 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1a57e816-fe97-4551-83ca-9ff8ee2fc65c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:31.046490 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1a57e816-fe97-4551-83ca-9ff8ee2fc65c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:31.047806 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1a57e816-fe97-4551-83ca-9ff8ee2fc65c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:31.048240 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1a57e816-fe97-4551-83ca-9ff8ee2fc65c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:31.106871 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1a57e816-fe97-4551-83ca-9ff8ee2fc65c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:31.114864 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1a57e816-fe97-4551-83ca-9ff8ee2fc65c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079146 Jul 19 09:41:31.115460 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 747/1466] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:31 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:31.259828 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-57dfc9cd-6546-433c-81a6-953e0502024d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:31.260436 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-57dfc9cd-6546-433c-81a6-953e0502024d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:31.266294 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-57dfc9cd-6546-433c-81a6-953e0502024d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:31.266749 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-57dfc9cd-6546-433c-81a6-953e0502024d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:31.267552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-57dfc9cd-6546-433c-81a6-953e0502024d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:31.267991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-57dfc9cd-6546-433c-81a6-953e0502024d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:31.328666 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-57dfc9cd-6546-433c-81a6-953e0502024d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:31.336395 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-57dfc9cd-6546-433c-81a6-953e0502024d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080389 Jul 19 09:41:31.336969 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 720/1467] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:31 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:32.131830 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8a0c8a23-5d0a-4734-93b9-0dcc19609c9a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:32.132487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8a0c8a23-5d0a-4734-93b9-0dcc19609c9a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:32.144076 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8a0c8a23-5d0a-4734-93b9-0dcc19609c9a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:32.144523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8a0c8a23-5d0a-4734-93b9-0dcc19609c9a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:32.145290 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8a0c8a23-5d0a-4734-93b9-0dcc19609c9a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:32.145717 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8a0c8a23-5d0a-4734-93b9-0dcc19609c9a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:32.206076 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8a0c8a23-5d0a-4734-93b9-0dcc19609c9a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:32.214039 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8a0c8a23-5d0a-4734-93b9-0dcc19609c9a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.085944 Jul 19 09:41:32.214802 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 748/1468] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:32 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:32.353638 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b7681070-70b1-4215-b41b-5b3936f69a60 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:32.354258 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b7681070-70b1-4215-b41b-5b3936f69a60 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:32.360331 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7681070-70b1-4215-b41b-5b3936f69a60 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:32.360855 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7681070-70b1-4215-b41b-5b3936f69a60 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:32.361621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7681070-70b1-4215-b41b-5b3936f69a60 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:32.362126 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b7681070-70b1-4215-b41b-5b3936f69a60 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:32.422694 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b7681070-70b1-4215-b41b-5b3936f69a60 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:32.430356 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b7681070-70b1-4215-b41b-5b3936f69a60 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080611 Jul 19 09:41:32.430916 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 721/1469] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:32 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:33.230504 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-634691cc-d908-4cbd-a4ca-974de60aad0c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:33.231137 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-634691cc-d908-4cbd-a4ca-974de60aad0c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:33.237505 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-634691cc-d908-4cbd-a4ca-974de60aad0c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:33.237950 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-634691cc-d908-4cbd-a4ca-974de60aad0c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:33.238698 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-634691cc-d908-4cbd-a4ca-974de60aad0c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:33.239157 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-634691cc-d908-4cbd-a4ca-974de60aad0c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:33.298740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-634691cc-d908-4cbd-a4ca-974de60aad0c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:33.306732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-634691cc-d908-4cbd-a4ca-974de60aad0c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079832 Jul 19 09:41:33.307342 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 749/1470] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:33 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:33.446477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2b054dd8-9d99-421b-ab78-7aaf94842dc0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:33.447016 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2b054dd8-9d99-421b-ab78-7aaf94842dc0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:33.453009 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2b054dd8-9d99-421b-ab78-7aaf94842dc0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:33.453456 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2b054dd8-9d99-421b-ab78-7aaf94842dc0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:33.454210 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2b054dd8-9d99-421b-ab78-7aaf94842dc0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:33.454643 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2b054dd8-9d99-421b-ab78-7aaf94842dc0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:33.516531 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2b054dd8-9d99-421b-ab78-7aaf94842dc0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:33.524288 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2b054dd8-9d99-421b-ab78-7aaf94842dc0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.081536 Jul 19 09:41:33.524963 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 722/1471] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:33 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:34.325427 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f2b510d0-e7ea-4e5c-a650-633aebce8fcc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:34.326014 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f2b510d0-e7ea-4e5c-a650-633aebce8fcc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:34.331789 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2b510d0-e7ea-4e5c-a650-633aebce8fcc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:34.332262 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2b510d0-e7ea-4e5c-a650-633aebce8fcc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:34.333010 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2b510d0-e7ea-4e5c-a650-633aebce8fcc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:34.333440 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2b510d0-e7ea-4e5c-a650-633aebce8fcc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:34.399520 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f2b510d0-e7ea-4e5c-a650-633aebce8fcc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:34.407664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f2b510d0-e7ea-4e5c-a650-633aebce8fcc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.086284 Jul 19 09:41:34.408224 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 750/1472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:34 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:34.541536 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4eed0d6d-1225-4b2b-9ae4-3423138f8c2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:34.542322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4eed0d6d-1225-4b2b-9ae4-3423138f8c2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:34.548726 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4eed0d6d-1225-4b2b-9ae4-3423138f8c2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:34.549172 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4eed0d6d-1225-4b2b-9ae4-3423138f8c2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:34.549927 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4eed0d6d-1225-4b2b-9ae4-3423138f8c2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:34.550387 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4eed0d6d-1225-4b2b-9ae4-3423138f8c2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:34.613317 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4eed0d6d-1225-4b2b-9ae4-3423138f8c2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:34.620872 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4eed0d6d-1225-4b2b-9ae4-3423138f8c2d tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.083474 Jul 19 09:41:34.621423 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 723/1473] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:34 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:35.424912 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8551d94b-f64e-46eb-890b-5c729e477ca2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:35.425468 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8551d94b-f64e-46eb-890b-5c729e477ca2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:35.431208 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8551d94b-f64e-46eb-890b-5c729e477ca2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:35.431652 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8551d94b-f64e-46eb-890b-5c729e477ca2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:35.432403 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8551d94b-f64e-46eb-890b-5c729e477ca2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:35.432830 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8551d94b-f64e-46eb-890b-5c729e477ca2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:35.491500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8551d94b-f64e-46eb-890b-5c729e477ca2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:35.498991 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8551d94b-f64e-46eb-890b-5c729e477ca2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078380 Jul 19 09:41:35.499575 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 751/1474] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:35 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:35.637199 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d49d8eb7-4f16-4b0c-9363-e424d8119228 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:35.637803 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d49d8eb7-4f16-4b0c-9363-e424d8119228 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:35.644100 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d49d8eb7-4f16-4b0c-9363-e424d8119228 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:35.644548 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d49d8eb7-4f16-4b0c-9363-e424d8119228 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:35.645305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d49d8eb7-4f16-4b0c-9363-e424d8119228 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:35.645772 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d49d8eb7-4f16-4b0c-9363-e424d8119228 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:35.705341 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d49d8eb7-4f16-4b0c-9363-e424d8119228 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:35.712921 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d49d8eb7-4f16-4b0c-9363-e424d8119228 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079352 Jul 19 09:41:35.713478 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 724/1475] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:35 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:36.515324 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4cfdfe62-52da-4b00-80f1-284beceba182 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:36.515934 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4cfdfe62-52da-4b00-80f1-284beceba182 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:36.521685 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4cfdfe62-52da-4b00-80f1-284beceba182 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:36.522132 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4cfdfe62-52da-4b00-80f1-284beceba182 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:36.522891 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4cfdfe62-52da-4b00-80f1-284beceba182 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:36.523345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4cfdfe62-52da-4b00-80f1-284beceba182 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:36.582402 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4cfdfe62-52da-4b00-80f1-284beceba182 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:36.590137 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4cfdfe62-52da-4b00-80f1-284beceba182 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078469 Jul 19 09:41:36.590680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 752/1476] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:36 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:36.730153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2825496f-d3ca-443c-91d7-aebefe9e4d3b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:36.730680 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2825496f-d3ca-443c-91d7-aebefe9e4d3b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:36.737137 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2825496f-d3ca-443c-91d7-aebefe9e4d3b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:36.737584 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2825496f-d3ca-443c-91d7-aebefe9e4d3b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:36.738340 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2825496f-d3ca-443c-91d7-aebefe9e4d3b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:36.738771 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2825496f-d3ca-443c-91d7-aebefe9e4d3b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:36.798155 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2825496f-d3ca-443c-91d7-aebefe9e4d3b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:36.805642 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2825496f-d3ca-443c-91d7-aebefe9e4d3b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079301 Jul 19 09:41:36.806198 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 725/1477] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:36 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:37.606909 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-73b7130e-cb59-41cc-a5ed-8a5aeadd5b04 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:37.607476 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-73b7130e-cb59-41cc-a5ed-8a5aeadd5b04 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:37.613302 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-73b7130e-cb59-41cc-a5ed-8a5aeadd5b04 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:37.613754 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-73b7130e-cb59-41cc-a5ed-8a5aeadd5b04 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:37.614511 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-73b7130e-cb59-41cc-a5ed-8a5aeadd5b04 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:37.614946 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-73b7130e-cb59-41cc-a5ed-8a5aeadd5b04 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:37.673530 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-73b7130e-cb59-41cc-a5ed-8a5aeadd5b04 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:37.681035 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-73b7130e-cb59-41cc-a5ed-8a5aeadd5b04 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.077815 Jul 19 09:41:37.681587 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 753/1478] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:37 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:37.821891 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d3643291-a5fe-43f8-a1d2-a5c1cd82710f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:37.822496 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d3643291-a5fe-43f8-a1d2-a5c1cd82710f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:37.828297 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d3643291-a5fe-43f8-a1d2-a5c1cd82710f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:37.828744 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d3643291-a5fe-43f8-a1d2-a5c1cd82710f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:37.829502 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d3643291-a5fe-43f8-a1d2-a5c1cd82710f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:37.829959 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d3643291-a5fe-43f8-a1d2-a5c1cd82710f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:37.888562 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d3643291-a5fe-43f8-a1d2-a5c1cd82710f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:37.896064 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d3643291-a5fe-43f8-a1d2-a5c1cd82710f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.077766 Jul 19 09:41:37.896616 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 726/1479] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:37 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:38.698175 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a2ac6901-d755-4313-af29-e89ac058a513 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:38.698718 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a2ac6901-d755-4313-af29-e89ac058a513 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:38.705067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a2ac6901-d755-4313-af29-e89ac058a513 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:38.705505 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a2ac6901-d755-4313-af29-e89ac058a513 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:38.706253 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a2ac6901-d755-4313-af29-e89ac058a513 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:38.706680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a2ac6901-d755-4313-af29-e89ac058a513 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:38.768407 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a2ac6901-d755-4313-af29-e89ac058a513 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:38.776013 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a2ac6901-d755-4313-af29-e89ac058a513 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081658 Jul 19 09:41:38.776563 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 754/1480] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:38 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:38.912350 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d85883e0-3104-443d-9149-508e5ecb6c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:38.912960 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d85883e0-3104-443d-9149-508e5ecb6c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:38.918938 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d85883e0-3104-443d-9149-508e5ecb6c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:38.919422 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d85883e0-3104-443d-9149-508e5ecb6c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:38.920185 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d85883e0-3104-443d-9149-508e5ecb6c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:38.920623 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d85883e0-3104-443d-9149-508e5ecb6c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:38.982613 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d85883e0-3104-443d-9149-508e5ecb6c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:38.990311 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d85883e0-3104-443d-9149-508e5ecb6c8b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.081577 Jul 19 09:41:38.990874 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 727/1481] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:38 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:39.792768 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-aadb69ce-1e33-4b25-8098-913094ef6e63 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:39.793445 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-aadb69ce-1e33-4b25-8098-913094ef6e63 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:39.799756 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aadb69ce-1e33-4b25-8098-913094ef6e63 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:39.800207 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aadb69ce-1e33-4b25-8098-913094ef6e63 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:39.800947 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aadb69ce-1e33-4b25-8098-913094ef6e63 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:39.801374 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aadb69ce-1e33-4b25-8098-913094ef6e63 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:39.860202 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-aadb69ce-1e33-4b25-8098-913094ef6e63 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:39.867937 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-aadb69ce-1e33-4b25-8098-913094ef6e63 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079105 Jul 19 09:41:39.868501 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 755/1482] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:39 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:40.006761 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-55956fb2-614d-4174-9319-2400eca9f73a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:40.007389 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-55956fb2-614d-4174-9319-2400eca9f73a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:40.013333 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-55956fb2-614d-4174-9319-2400eca9f73a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:40.013793 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-55956fb2-614d-4174-9319-2400eca9f73a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:40.014596 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-55956fb2-614d-4174-9319-2400eca9f73a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:40.015052 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-55956fb2-614d-4174-9319-2400eca9f73a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:40.079734 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-55956fb2-614d-4174-9319-2400eca9f73a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:40.087654 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-55956fb2-614d-4174-9319-2400eca9f73a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.084637 Jul 19 09:41:40.088221 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 728/1483] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:40 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:40.884683 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f04b9496-1d43-4ef2-828c-2fe976ea8cee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:40.885225 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f04b9496-1d43-4ef2-828c-2fe976ea8cee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:40.891067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f04b9496-1d43-4ef2-828c-2fe976ea8cee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:40.891532 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f04b9496-1d43-4ef2-828c-2fe976ea8cee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:40.892296 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f04b9496-1d43-4ef2-828c-2fe976ea8cee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:40.892734 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f04b9496-1d43-4ef2-828c-2fe976ea8cee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:40.953074 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f04b9496-1d43-4ef2-828c-2fe976ea8cee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:40.961098 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f04b9496-1d43-4ef2-828c-2fe976ea8cee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.080193 Jul 19 09:41:40.961679 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 756/1484] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:40 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:41.105223 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f0b2a81c-c682-47f2-bd3f-b0e3693cdfae tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:41.105854 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f0b2a81c-c682-47f2-bd3f-b0e3693cdfae tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:41.112372 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f0b2a81c-c682-47f2-bd3f-b0e3693cdfae tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:41.112826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f0b2a81c-c682-47f2-bd3f-b0e3693cdfae tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:41.113619 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f0b2a81c-c682-47f2-bd3f-b0e3693cdfae tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:41.114065 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f0b2a81c-c682-47f2-bd3f-b0e3693cdfae tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:41.176153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f0b2a81c-c682-47f2-bd3f-b0e3693cdfae tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:41.184057 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f0b2a81c-c682-47f2-bd3f-b0e3693cdfae tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.082569 Jul 19 09:41:41.184636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 729/1485] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:41 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:41.977817 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-737404dd-06d9-4265-9b3b-448a2cfc4d87 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:41.978436 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-737404dd-06d9-4265-9b3b-448a2cfc4d87 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:41.984269 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-737404dd-06d9-4265-9b3b-448a2cfc4d87 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:41.984711 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-737404dd-06d9-4265-9b3b-448a2cfc4d87 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:41.985474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-737404dd-06d9-4265-9b3b-448a2cfc4d87 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:41.985904 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-737404dd-06d9-4265-9b3b-448a2cfc4d87 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:42.046913 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-737404dd-06d9-4265-9b3b-448a2cfc4d87 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:42.055068 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-737404dd-06d9-4265-9b3b-448a2cfc4d87 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.080878 Jul 19 09:41:42.055655 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 757/1486] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:41 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:42.201251 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f60d698a-126d-4d59-991f-9b611648cebc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:42.201883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f60d698a-126d-4d59-991f-9b611648cebc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:42.208419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f60d698a-126d-4d59-991f-9b611648cebc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:42.208857 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f60d698a-126d-4d59-991f-9b611648cebc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:42.209670 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f60d698a-126d-4d59-991f-9b611648cebc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:42.210095 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f60d698a-126d-4d59-991f-9b611648cebc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:42.271361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f60d698a-126d-4d59-991f-9b611648cebc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:42.279327 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f60d698a-126d-4d59-991f-9b611648cebc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.081664 Jul 19 09:41:42.279911 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 730/1487] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:42 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:43.072190 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-423ab060-3555-45df-9a48-dc3da73389f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:43.072807 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-423ab060-3555-45df-9a48-dc3da73389f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:43.079223 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-423ab060-3555-45df-9a48-dc3da73389f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:43.079676 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-423ab060-3555-45df-9a48-dc3da73389f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:43.080449 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-423ab060-3555-45df-9a48-dc3da73389f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:43.080883 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-423ab060-3555-45df-9a48-dc3da73389f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:43.145572 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-423ab060-3555-45df-9a48-dc3da73389f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:43.153386 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-423ab060-3555-45df-9a48-dc3da73389f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.084840 Jul 19 09:41:43.153993 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 758/1488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:43 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:43.296091 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6aa44057-b758-4fbe-967a-a80cd379c870 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:43.296704 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6aa44057-b758-4fbe-967a-a80cd379c870 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:43.302604 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6aa44057-b758-4fbe-967a-a80cd379c870 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:43.303077 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6aa44057-b758-4fbe-967a-a80cd379c870 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:43.303851 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6aa44057-b758-4fbe-967a-a80cd379c870 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:43.304286 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6aa44057-b758-4fbe-967a-a80cd379c870 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:43.407357 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6aa44057-b758-4fbe-967a-a80cd379c870 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:43.415457 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6aa44057-b758-4fbe-967a-a80cd379c870 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.122977 Jul 19 09:41:43.416032 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 731/1489] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:43 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:44.169869 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-16e41f69-03e0-4d91-9800-5350eb8ac3c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:44.170479 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-16e41f69-03e0-4d91-9800-5350eb8ac3c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:44.177182 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16e41f69-03e0-4d91-9800-5350eb8ac3c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:44.177633 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16e41f69-03e0-4d91-9800-5350eb8ac3c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:44.178426 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16e41f69-03e0-4d91-9800-5350eb8ac3c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:44.178836 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-16e41f69-03e0-4d91-9800-5350eb8ac3c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:44.246262 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-16e41f69-03e0-4d91-9800-5350eb8ac3c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:44.254206 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-16e41f69-03e0-4d91-9800-5350eb8ac3c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.087971 Jul 19 09:41:44.254773 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 759/1490] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:44 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:44.432168 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3dccf7f1-3dcd-489c-9707-e7d98d9f08c6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:44.432773 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3dccf7f1-3dcd-489c-9707-e7d98d9f08c6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:44.438643 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3dccf7f1-3dcd-489c-9707-e7d98d9f08c6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:44.439136 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3dccf7f1-3dcd-489c-9707-e7d98d9f08c6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:44.439886 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3dccf7f1-3dcd-489c-9707-e7d98d9f08c6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:44.440317 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3dccf7f1-3dcd-489c-9707-e7d98d9f08c6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:44.501669 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3dccf7f1-3dcd-489c-9707-e7d98d9f08c6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:44.509594 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3dccf7f1-3dcd-489c-9707-e7d98d9f08c6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.081127 Jul 19 09:41:44.510157 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 732/1491] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:44 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:45.270502 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a4bcc24e-a7c9-475a-bf7a-abf25299b5bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:45.271211 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a4bcc24e-a7c9-475a-bf7a-abf25299b5bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:45.277059 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4bcc24e-a7c9-475a-bf7a-abf25299b5bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:45.277504 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4bcc24e-a7c9-475a-bf7a-abf25299b5bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:45.278267 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4bcc24e-a7c9-475a-bf7a-abf25299b5bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:45.278693 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a4bcc24e-a7c9-475a-bf7a-abf25299b5bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:45.338597 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a4bcc24e-a7c9-475a-bf7a-abf25299b5bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:45.346532 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a4bcc24e-a7c9-475a-bf7a-abf25299b5bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079826 Jul 19 09:41:45.347118 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 760/1492] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:45 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:45.527627 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2a93542f-ffde-42ea-8356-1d905869272a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:45.528183 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2a93542f-ffde-42ea-8356-1d905869272a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:45.534046 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2a93542f-ffde-42ea-8356-1d905869272a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:45.534535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2a93542f-ffde-42ea-8356-1d905869272a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:45.535315 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2a93542f-ffde-42ea-8356-1d905869272a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:45.535750 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2a93542f-ffde-42ea-8356-1d905869272a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:45.596715 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2a93542f-ffde-42ea-8356-1d905869272a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:45.604459 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2a93542f-ffde-42ea-8356-1d905869272a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080570 Jul 19 09:41:45.605027 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 733/1493] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:45 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:46.363599 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7a666f49-b4ca-4aa3-a703-d801d17dcd2c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:46.364201 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7a666f49-b4ca-4aa3-a703-d801d17dcd2c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:46.370166 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7a666f49-b4ca-4aa3-a703-d801d17dcd2c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:46.370605 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7a666f49-b4ca-4aa3-a703-d801d17dcd2c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:46.371389 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7a666f49-b4ca-4aa3-a703-d801d17dcd2c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:46.371818 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7a666f49-b4ca-4aa3-a703-d801d17dcd2c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:46.431640 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7a666f49-b4ca-4aa3-a703-d801d17dcd2c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:46.440102 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7a666f49-b4ca-4aa3-a703-d801d17dcd2c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.080555 Jul 19 09:41:46.440670 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 761/1494] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:46 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:46.621524 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f45444fd-3ba8-4efd-a7ed-0f6b072bfcd4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:46.622122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f45444fd-3ba8-4efd-a7ed-0f6b072bfcd4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:46.628426 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f45444fd-3ba8-4efd-a7ed-0f6b072bfcd4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:46.628863 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f45444fd-3ba8-4efd-a7ed-0f6b072bfcd4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:46.629608 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f45444fd-3ba8-4efd-a7ed-0f6b072bfcd4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:46.630030 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f45444fd-3ba8-4efd-a7ed-0f6b072bfcd4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:46.690614 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f45444fd-3ba8-4efd-a7ed-0f6b072bfcd4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:46.698227 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f45444fd-3ba8-4efd-a7ed-0f6b072bfcd4 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080353 Jul 19 09:41:46.698781 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 734/1495] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:46 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:47.457262 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c40a4d48-2cf0-4be6-88a5-ef39eb018ded tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:47.457801 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c40a4d48-2cf0-4be6-88a5-ef39eb018ded tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:47.463594 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c40a4d48-2cf0-4be6-88a5-ef39eb018ded tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:47.464050 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c40a4d48-2cf0-4be6-88a5-ef39eb018ded tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:47.464820 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c40a4d48-2cf0-4be6-88a5-ef39eb018ded tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:47.465256 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c40a4d48-2cf0-4be6-88a5-ef39eb018ded tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:47.527397 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c40a4d48-2cf0-4be6-88a5-ef39eb018ded tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:47.535669 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c40a4d48-2cf0-4be6-88a5-ef39eb018ded tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.082154 Jul 19 09:41:47.536233 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 762/1496] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:47 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:47.715500 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e5be9748-2a18-4600-851b-12755c5a3099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:47.716035 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e5be9748-2a18-4600-851b-12755c5a3099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:47.722362 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e5be9748-2a18-4600-851b-12755c5a3099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:47.722809 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e5be9748-2a18-4600-851b-12755c5a3099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:47.723595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e5be9748-2a18-4600-851b-12755c5a3099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:47.724035 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e5be9748-2a18-4600-851b-12755c5a3099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:47.786518 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e5be9748-2a18-4600-851b-12755c5a3099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:47.794368 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e5be9748-2a18-4600-851b-12755c5a3099 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.082664 Jul 19 09:41:47.794925 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 735/1497] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:47 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:48.552924 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ab2f0ac3-c68c-41c4-8cb9-e670bec71699 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:48.553554 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ab2f0ac3-c68c-41c4-8cb9-e670bec71699 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:48.559544 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ab2f0ac3-c68c-41c4-8cb9-e670bec71699 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:48.559995 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ab2f0ac3-c68c-41c4-8cb9-e670bec71699 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:48.560761 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ab2f0ac3-c68c-41c4-8cb9-e670bec71699 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:48.561195 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ab2f0ac3-c68c-41c4-8cb9-e670bec71699 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:48.622450 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ab2f0ac3-c68c-41c4-8cb9-e670bec71699 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:48.630307 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ab2f0ac3-c68c-41c4-8cb9-e670bec71699 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081072 Jul 19 09:41:48.630878 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 763/1498] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:48 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:48.810945 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ba79a400-49f8-4d8b-8c7d-dd1c1e387ad6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:48.811528 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ba79a400-49f8-4d8b-8c7d-dd1c1e387ad6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:48.817597 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba79a400-49f8-4d8b-8c7d-dd1c1e387ad6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:48.818022 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba79a400-49f8-4d8b-8c7d-dd1c1e387ad6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:48.819145 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba79a400-49f8-4d8b-8c7d-dd1c1e387ad6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:48.819298 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba79a400-49f8-4d8b-8c7d-dd1c1e387ad6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:48.880123 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ba79a400-49f8-4d8b-8c7d-dd1c1e387ad6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:48.887818 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ba79a400-49f8-4d8b-8c7d-dd1c1e387ad6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080635 Jul 19 09:41:48.888383 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 736/1499] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:48 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:49.647369 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-667845b8-0027-4b1f-b06c-b9ab4d8acc85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:49.647987 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-667845b8-0027-4b1f-b06c-b9ab4d8acc85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:49.653931 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-667845b8-0027-4b1f-b06c-b9ab4d8acc85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:49.654388 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-667845b8-0027-4b1f-b06c-b9ab4d8acc85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:49.655190 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-667845b8-0027-4b1f-b06c-b9ab4d8acc85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:49.655652 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-667845b8-0027-4b1f-b06c-b9ab4d8acc85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:49.716248 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-667845b8-0027-4b1f-b06c-b9ab4d8acc85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:49.723962 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-667845b8-0027-4b1f-b06c-b9ab4d8acc85 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.080276 Jul 19 09:41:49.724534 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 764/1500] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:49 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:49.904346 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4fd99bf2-1302-41d6-aea6-9baad3d6d07b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:49.904987 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4fd99bf2-1302-41d6-aea6-9baad3d6d07b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:49.910827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4fd99bf2-1302-41d6-aea6-9baad3d6d07b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:49.911315 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4fd99bf2-1302-41d6-aea6-9baad3d6d07b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:49.912088 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4fd99bf2-1302-41d6-aea6-9baad3d6d07b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:49.912524 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4fd99bf2-1302-41d6-aea6-9baad3d6d07b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:49.972525 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4fd99bf2-1302-41d6-aea6-9baad3d6d07b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:49.980646 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4fd99bf2-1302-41d6-aea6-9baad3d6d07b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079938 Jul 19 09:41:49.981224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 737/1501] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:49 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:50.740508 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5e6fb906-e802-414c-abd2-b6f1cd91414b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:50.741053 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5e6fb906-e802-414c-abd2-b6f1cd91414b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:50.746837 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5e6fb906-e802-414c-abd2-b6f1cd91414b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:50.747309 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5e6fb906-e802-414c-abd2-b6f1cd91414b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:50.748061 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5e6fb906-e802-414c-abd2-b6f1cd91414b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:50.748490 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5e6fb906-e802-414c-abd2-b6f1cd91414b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:50.808745 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5e6fb906-e802-414c-abd2-b6f1cd91414b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:50.816342 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5e6fb906-e802-414c-abd2-b6f1cd91414b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079547 Jul 19 09:41:50.816900 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 765/1502] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:50 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:50.997671 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-dac851d8-5540-4ae2-991b-1d41820c47d6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:50.998192 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-dac851d8-5540-4ae2-991b-1d41820c47d6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:51.004513 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dac851d8-5540-4ae2-991b-1d41820c47d6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:51.004956 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dac851d8-5540-4ae2-991b-1d41820c47d6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:51.005711 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dac851d8-5540-4ae2-991b-1d41820c47d6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:51.006147 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dac851d8-5540-4ae2-991b-1d41820c47d6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:51.065607 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-dac851d8-5540-4ae2-991b-1d41820c47d6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:51.073219 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-dac851d8-5540-4ae2-991b-1d41820c47d6 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079376 Jul 19 09:41:51.073779 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 738/1503] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:50 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:51.832754 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4bc3af49-0b4d-4f72-9ca3-103ceb3235f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:51.833364 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4bc3af49-0b4d-4f72-9ca3-103ceb3235f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:51.839235 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4bc3af49-0b4d-4f72-9ca3-103ceb3235f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:51.839695 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4bc3af49-0b4d-4f72-9ca3-103ceb3235f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:51.840469 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4bc3af49-0b4d-4f72-9ca3-103ceb3235f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:51.840907 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4bc3af49-0b4d-4f72-9ca3-103ceb3235f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:51.903731 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4bc3af49-0b4d-4f72-9ca3-103ceb3235f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:51.911686 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4bc3af49-0b4d-4f72-9ca3-103ceb3235f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.082650 Jul 19 09:41:51.912245 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 766/1504] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:51 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:52.090248 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-83a737be-6f7f-4139-80fd-bbdddc7f0d74 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:52.090808 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-83a737be-6f7f-4139-80fd-bbdddc7f0d74 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:52.097221 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-83a737be-6f7f-4139-80fd-bbdddc7f0d74 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:52.097667 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-83a737be-6f7f-4139-80fd-bbdddc7f0d74 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:52.098438 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-83a737be-6f7f-4139-80fd-bbdddc7f0d74 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:52.098892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-83a737be-6f7f-4139-80fd-bbdddc7f0d74 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:52.414182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-83a737be-6f7f-4139-80fd-bbdddc7f0d74 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:52.422228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-83a737be-6f7f-4139-80fd-bbdddc7f0d74 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.335622 Jul 19 09:41:52.422786 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 739/1505] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:52 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:52.929644 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-952c55c0-80c9-4c6d-b7f0-1ef7249a30c8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:52.930245 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-952c55c0-80c9-4c6d-b7f0-1ef7249a30c8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:52.935966 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-952c55c0-80c9-4c6d-b7f0-1ef7249a30c8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:52.936409 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-952c55c0-80c9-4c6d-b7f0-1ef7249a30c8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:52.937776 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-952c55c0-80c9-4c6d-b7f0-1ef7249a30c8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:52.938201 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-952c55c0-80c9-4c6d-b7f0-1ef7249a30c8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:52.996700 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-952c55c0-80c9-4c6d-b7f0-1ef7249a30c8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:53.004833 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-952c55c0-80c9-4c6d-b7f0-1ef7249a30c8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078820 Jul 19 09:41:53.005389 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 767/1506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:52 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:53.438575 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e878d580-7e4a-4534-ab90-993c2c30d681 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:53.439220 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e878d580-7e4a-4534-ab90-993c2c30d681 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:53.445048 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e878d580-7e4a-4534-ab90-993c2c30d681 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:53.445529 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e878d580-7e4a-4534-ab90-993c2c30d681 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:53.446298 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e878d580-7e4a-4534-ab90-993c2c30d681 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:53.446733 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e878d580-7e4a-4534-ab90-993c2c30d681 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:53.505355 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e878d580-7e4a-4534-ab90-993c2c30d681 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:53.512989 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e878d580-7e4a-4534-ab90-993c2c30d681 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078064 Jul 19 09:41:53.513589 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 740/1507] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:53 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:54.021435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-75ddb098-4611-42be-a2ec-3406b1ad04d5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:54.022069 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-75ddb098-4611-42be-a2ec-3406b1ad04d5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:54.027821 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75ddb098-4611-42be-a2ec-3406b1ad04d5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:54.028269 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75ddb098-4611-42be-a2ec-3406b1ad04d5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:54.029017 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75ddb098-4611-42be-a2ec-3406b1ad04d5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:54.029443 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-75ddb098-4611-42be-a2ec-3406b1ad04d5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:54.089021 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-75ddb098-4611-42be-a2ec-3406b1ad04d5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:54.096477 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-75ddb098-4611-42be-a2ec-3406b1ad04d5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078652 Jul 19 09:41:54.097025 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 768/1508] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:54 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:54.529496 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d4e52549-daba-4d26-9f93-53c3ec4292e3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:54.530103 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d4e52549-daba-4d26-9f93-53c3ec4292e3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:54.535968 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d4e52549-daba-4d26-9f93-53c3ec4292e3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:54.536415 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d4e52549-daba-4d26-9f93-53c3ec4292e3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:54.537188 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d4e52549-daba-4d26-9f93-53c3ec4292e3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:54.537636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d4e52549-daba-4d26-9f93-53c3ec4292e3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:54.597370 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d4e52549-daba-4d26-9f93-53c3ec4292e3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:54.604857 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d4e52549-daba-4d26-9f93-53c3ec4292e3 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079056 Jul 19 09:41:54.605412 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 741/1509] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:54 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:55.112688 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5ca45dc8-c07c-4ef1-8a67-54f3229aec61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:55.113290 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5ca45dc8-c07c-4ef1-8a67-54f3229aec61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:55.118998 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5ca45dc8-c07c-4ef1-8a67-54f3229aec61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:55.119466 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5ca45dc8-c07c-4ef1-8a67-54f3229aec61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:55.120215 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5ca45dc8-c07c-4ef1-8a67-54f3229aec61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:55.120639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5ca45dc8-c07c-4ef1-8a67-54f3229aec61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:55.181045 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5ca45dc8-c07c-4ef1-8a67-54f3229aec61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:55.188686 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5ca45dc8-c07c-4ef1-8a67-54f3229aec61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079590 Jul 19 09:41:55.189237 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 769/1510] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:55 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:55.621798 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ca6e18b5-49a6-4eef-9e6a-97869c88f4a2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:55.622406 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ca6e18b5-49a6-4eef-9e6a-97869c88f4a2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:55.628757 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca6e18b5-49a6-4eef-9e6a-97869c88f4a2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:55.629203 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca6e18b5-49a6-4eef-9e6a-97869c88f4a2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:55.629975 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca6e18b5-49a6-4eef-9e6a-97869c88f4a2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:55.630388 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ca6e18b5-49a6-4eef-9e6a-97869c88f4a2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:55.689535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ca6e18b5-49a6-4eef-9e6a-97869c88f4a2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:55.696988 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ca6e18b5-49a6-4eef-9e6a-97869c88f4a2 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078771 Jul 19 09:41:55.697538 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 742/1511] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:55 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:56.205598 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e1ae7414-55c4-4a74-8866-968345c2796f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:56.206199 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e1ae7414-55c4-4a74-8866-968345c2796f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:56.211977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e1ae7414-55c4-4a74-8866-968345c2796f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:56.212424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e1ae7414-55c4-4a74-8866-968345c2796f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:56.213170 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e1ae7414-55c4-4a74-8866-968345c2796f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:56.213599 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e1ae7414-55c4-4a74-8866-968345c2796f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:56.275048 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e1ae7414-55c4-4a74-8866-968345c2796f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:56.282673 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e1ae7414-55c4-4a74-8866-968345c2796f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081379 Jul 19 09:41:56.283265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 770/1512] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:56 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:56.713478 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-762f051a-0911-4906-bf0f-1f3e13655fd1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:56.714020 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-762f051a-0911-4906-bf0f-1f3e13655fd1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:56.719915 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-762f051a-0911-4906-bf0f-1f3e13655fd1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:56.720275 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-762f051a-0911-4906-bf0f-1f3e13655fd1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:56.721028 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-762f051a-0911-4906-bf0f-1f3e13655fd1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:56.721462 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-762f051a-0911-4906-bf0f-1f3e13655fd1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:56.783695 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-762f051a-0911-4906-bf0f-1f3e13655fd1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:56.791490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-762f051a-0911-4906-bf0f-1f3e13655fd1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.081675 Jul 19 09:41:56.792046 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 743/1513] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:56 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:57.299550 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-700297f6-c120-4de2-9eda-1b6e280bc9ec tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:57.300149 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-700297f6-c120-4de2-9eda-1b6e280bc9ec tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:57.305857 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-700297f6-c120-4de2-9eda-1b6e280bc9ec tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:57.306300 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-700297f6-c120-4de2-9eda-1b6e280bc9ec tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:57.307073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-700297f6-c120-4de2-9eda-1b6e280bc9ec tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:57.307504 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-700297f6-c120-4de2-9eda-1b6e280bc9ec tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:57.366398 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-700297f6-c120-4de2-9eda-1b6e280bc9ec tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:57.373910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-700297f6-c120-4de2-9eda-1b6e280bc9ec tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078061 Jul 19 09:41:57.374463 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 771/1514] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:57 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:57.807503 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-87123f3f-dcb7-4363-8194-252ee062da4b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:57.808101 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-87123f3f-dcb7-4363-8194-252ee062da4b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:57.814284 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-87123f3f-dcb7-4363-8194-252ee062da4b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:57.814725 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-87123f3f-dcb7-4363-8194-252ee062da4b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:57.815497 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-87123f3f-dcb7-4363-8194-252ee062da4b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:57.815924 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-87123f3f-dcb7-4363-8194-252ee062da4b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:57.874002 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-87123f3f-dcb7-4363-8194-252ee062da4b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:57.881956 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-87123f3f-dcb7-4363-8194-252ee062da4b tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078046 Jul 19 09:41:57.882504 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 744/1515] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:57 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:58.390375 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-828c37dc-eeb5-4b7d-85a7-ff0a690d5a7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:58.390974 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-828c37dc-eeb5-4b7d-85a7-ff0a690d5a7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:58.396800 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-828c37dc-eeb5-4b7d-85a7-ff0a690d5a7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:58.397238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-828c37dc-eeb5-4b7d-85a7-ff0a690d5a7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:58.397986 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-828c37dc-eeb5-4b7d-85a7-ff0a690d5a7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:58.398412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-828c37dc-eeb5-4b7d-85a7-ff0a690d5a7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:58.457241 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-828c37dc-eeb5-4b7d-85a7-ff0a690d5a7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:58.464800 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-828c37dc-eeb5-4b7d-85a7-ff0a690d5a7c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078100 Jul 19 09:41:58.465345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 772/1516] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:58 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:58.898455 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d749875b-2628-498d-ba22-739c5c15aecc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:58.898978 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d749875b-2628-498d-ba22-739c5c15aecc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:58.904709 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d749875b-2628-498d-ba22-739c5c15aecc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:58.905158 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d749875b-2628-498d-ba22-739c5c15aecc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:58.905912 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d749875b-2628-498d-ba22-739c5c15aecc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:58.906343 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d749875b-2628-498d-ba22-739c5c15aecc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:58.965445 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d749875b-2628-498d-ba22-739c5c15aecc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:58.973613 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d749875b-2628-498d-ba22-739c5c15aecc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078879 Jul 19 09:41:58.974405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 745/1517] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:58 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:59.481779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ac3d6416-5fe0-4bf2-ab7e-49692828ef39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:59.482335 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ac3d6416-5fe0-4bf2-ab7e-49692828ef39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:59.488655 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ac3d6416-5fe0-4bf2-ab7e-49692828ef39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:59.489103 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ac3d6416-5fe0-4bf2-ab7e-49692828ef39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:59.489860 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ac3d6416-5fe0-4bf2-ab7e-49692828ef39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:59.490320 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ac3d6416-5fe0-4bf2-ab7e-49692828ef39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:59.549403 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ac3d6416-5fe0-4bf2-ab7e-49692828ef39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:41:59.556896 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ac3d6416-5fe0-4bf2-ab7e-49692828ef39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078812 Jul 19 09:41:59.557452 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 773/1518] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:59 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:41:59.990787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-14bb08b4-5f38-4839-818c-c419dc11fe6f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:41:59.991422 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-14bb08b4-5f38-4839-818c-c419dc11fe6f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:41:59.997140 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14bb08b4-5f38-4839-818c-c419dc11fe6f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:59.997586 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14bb08b4-5f38-4839-818c-c419dc11fe6f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:41:59.998343 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14bb08b4-5f38-4839-818c-c419dc11fe6f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:41:59.998775 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-14bb08b4-5f38-4839-818c-c419dc11fe6f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:00.057834 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-14bb08b4-5f38-4839-818c-c419dc11fe6f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:00.065423 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-14bb08b4-5f38-4839-818c-c419dc11fe6f tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078243 Jul 19 09:42:00.066054 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 746/1519] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:41:59 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:00.573918 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f17fc68f-a13e-4b2f-8084-a9435e5c21ba tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:00.574532 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f17fc68f-a13e-4b2f-8084-a9435e5c21ba tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:00.580884 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f17fc68f-a13e-4b2f-8084-a9435e5c21ba tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:00.581338 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f17fc68f-a13e-4b2f-8084-a9435e5c21ba tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:00.582105 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f17fc68f-a13e-4b2f-8084-a9435e5c21ba tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:00.582541 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f17fc68f-a13e-4b2f-8084-a9435e5c21ba tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:00.644546 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f17fc68f-a13e-4b2f-8084-a9435e5c21ba tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:00.652249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f17fc68f-a13e-4b2f-8084-a9435e5c21ba tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.082012 Jul 19 09:42:00.652817 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 774/1520] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:00 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:01.081484 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b1a280e7-a6e3-4fe5-bb1a-605663d246dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:01.082122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b1a280e7-a6e3-4fe5-bb1a-605663d246dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:01.087890 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1a280e7-a6e3-4fe5-bb1a-605663d246dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:01.088336 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1a280e7-a6e3-4fe5-bb1a-605663d246dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:01.089097 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1a280e7-a6e3-4fe5-bb1a-605663d246dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:01.089551 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1a280e7-a6e3-4fe5-bb1a-605663d246dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:01.151879 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b1a280e7-a6e3-4fe5-bb1a-605663d246dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:01.159548 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b1a280e7-a6e3-4fe5-bb1a-605663d246dc tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.081806 Jul 19 09:42:01.160104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 747/1521] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:01 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:01.668325 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a2d5c496-20c5-4b9f-b703-1afbd2f55c6a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:01.668937 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a2d5c496-20c5-4b9f-b703-1afbd2f55c6a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:01.675354 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a2d5c496-20c5-4b9f-b703-1afbd2f55c6a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:01.675808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a2d5c496-20c5-4b9f-b703-1afbd2f55c6a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:01.676571 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a2d5c496-20c5-4b9f-b703-1afbd2f55c6a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:01.677005 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a2d5c496-20c5-4b9f-b703-1afbd2f55c6a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:01.735490 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a2d5c496-20c5-4b9f-b703-1afbd2f55c6a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:01.742956 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a2d5c496-20c5-4b9f-b703-1afbd2f55c6a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078539 Jul 19 09:42:01.743549 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 775/1522] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:01 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:02.176412 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a8381ebf-3df9-4b2d-919c-ec636bcbdf99 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:02.177014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a8381ebf-3df9-4b2d-919c-ec636bcbdf99 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:02.182723 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a8381ebf-3df9-4b2d-919c-ec636bcbdf99 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:02.183207 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a8381ebf-3df9-4b2d-919c-ec636bcbdf99 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:02.183990 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a8381ebf-3df9-4b2d-919c-ec636bcbdf99 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:02.184421 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a8381ebf-3df9-4b2d-919c-ec636bcbdf99 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:02.244214 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a8381ebf-3df9-4b2d-919c-ec636bcbdf99 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:02.252249 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a8381ebf-3df9-4b2d-919c-ec636bcbdf99 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079458 Jul 19 09:42:02.252802 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 748/1523] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:02 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:02.758553 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-123f2e37-a167-4315-9204-fd3a15f55c7a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:02.759138 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-123f2e37-a167-4315-9204-fd3a15f55c7a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:02.764930 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-123f2e37-a167-4315-9204-fd3a15f55c7a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:02.765378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-123f2e37-a167-4315-9204-fd3a15f55c7a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:02.766166 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-123f2e37-a167-4315-9204-fd3a15f55c7a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:02.766603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-123f2e37-a167-4315-9204-fd3a15f55c7a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:02.825091 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-123f2e37-a167-4315-9204-fd3a15f55c7a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:02.832501 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-123f2e37-a167-4315-9204-fd3a15f55c7a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.077690 Jul 19 09:42:02.833056 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 776/1524] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:02 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:03.268991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1c4edf74-e5a7-438d-bc4b-6eb4e814646a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:03.269606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1c4edf74-e5a7-438d-bc4b-6eb4e814646a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:03.275485 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c4edf74-e5a7-438d-bc4b-6eb4e814646a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:03.275939 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c4edf74-e5a7-438d-bc4b-6eb4e814646a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:03.276701 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c4edf74-e5a7-438d-bc4b-6eb4e814646a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:03.277139 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c4edf74-e5a7-438d-bc4b-6eb4e814646a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:03.338294 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1c4edf74-e5a7-438d-bc4b-6eb4e814646a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:03.346635 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1c4edf74-e5a7-438d-bc4b-6eb4e814646a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.082017 Jul 19 09:42:03.347219 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 749/1525] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:03 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:03.848891 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4de87e27-3850-48aa-8df5-eca86099a670 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:03.849441 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4de87e27-3850-48aa-8df5-eca86099a670 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:03.855170 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4de87e27-3850-48aa-8df5-eca86099a670 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:03.855618 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4de87e27-3850-48aa-8df5-eca86099a670 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:03.856376 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4de87e27-3850-48aa-8df5-eca86099a670 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:03.856807 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4de87e27-3850-48aa-8df5-eca86099a670 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:03.916113 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4de87e27-3850-48aa-8df5-eca86099a670 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:03.924046 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4de87e27-3850-48aa-8df5-eca86099a670 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078929 Jul 19 09:42:03.924600 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 777/1526] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:03 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:04.363497 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2778ce78-38b2-4f44-9639-45dbc9a8ad96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:04.364157 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2778ce78-38b2-4f44-9639-45dbc9a8ad96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:04.370033 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2778ce78-38b2-4f44-9639-45dbc9a8ad96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:04.370485 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2778ce78-38b2-4f44-9639-45dbc9a8ad96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:04.371282 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2778ce78-38b2-4f44-9639-45dbc9a8ad96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:04.371725 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2778ce78-38b2-4f44-9639-45dbc9a8ad96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:04.432745 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2778ce78-38b2-4f44-9639-45dbc9a8ad96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:04.440525 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2778ce78-38b2-4f44-9639-45dbc9a8ad96 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.081326 Jul 19 09:42:04.441079 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 750/1527] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:04 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:04.940540 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-29c9ec89-774f-4268-8881-87d798a29f20 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:04.941155 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-29c9ec89-774f-4268-8881-87d798a29f20 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:04.946913 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-29c9ec89-774f-4268-8881-87d798a29f20 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:04.947394 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-29c9ec89-774f-4268-8881-87d798a29f20 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:04.948157 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-29c9ec89-774f-4268-8881-87d798a29f20 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:04.948592 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-29c9ec89-774f-4268-8881-87d798a29f20 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:05.011584 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-29c9ec89-774f-4268-8881-87d798a29f20 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:05.019702 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-29c9ec89-774f-4268-8881-87d798a29f20 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.083001 Jul 19 09:42:05.020263 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 778/1528] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:04 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:05.456740 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-465a87dd-5c01-41b7-bc35-be09972969a8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:05.457338 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-465a87dd-5c01-41b7-bc35-be09972969a8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:05.463143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-465a87dd-5c01-41b7-bc35-be09972969a8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:05.463594 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-465a87dd-5c01-41b7-bc35-be09972969a8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:05.464353 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-465a87dd-5c01-41b7-bc35-be09972969a8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:05.464787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-465a87dd-5c01-41b7-bc35-be09972969a8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:05.526490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-465a87dd-5c01-41b7-bc35-be09972969a8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:05.534033 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-465a87dd-5c01-41b7-bc35-be09972969a8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080963 Jul 19 09:42:05.534618 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 751/1529] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:05 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:06.036638 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9369bd80-1b44-480e-be76-8c9ac03a4886 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:06.037246 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9369bd80-1b44-480e-be76-8c9ac03a4886 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:06.043458 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9369bd80-1b44-480e-be76-8c9ac03a4886 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:06.043901 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9369bd80-1b44-480e-be76-8c9ac03a4886 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:06.044651 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9369bd80-1b44-480e-be76-8c9ac03a4886 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:06.045080 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9369bd80-1b44-480e-be76-8c9ac03a4886 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:06.105359 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9369bd80-1b44-480e-be76-8c9ac03a4886 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:06.113738 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9369bd80-1b44-480e-be76-8c9ac03a4886 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.080744 Jul 19 09:42:06.114292 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 779/1530] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:06 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:06.550651 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0c9b9a15-bcdb-4b71-b20b-6cdb6c8487c1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:06.551290 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0c9b9a15-bcdb-4b71-b20b-6cdb6c8487c1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:06.557034 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c9b9a15-bcdb-4b71-b20b-6cdb6c8487c1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:06.557483 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c9b9a15-bcdb-4b71-b20b-6cdb6c8487c1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:06.558245 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c9b9a15-bcdb-4b71-b20b-6cdb6c8487c1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:06.558677 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0c9b9a15-bcdb-4b71-b20b-6cdb6c8487c1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:06.617517 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0c9b9a15-bcdb-4b71-b20b-6cdb6c8487c1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:06.624978 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0c9b9a15-bcdb-4b71-b20b-6cdb6c8487c1 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.077992 Jul 19 09:42:06.625529 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 752/1531] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:06 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:07.130638 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2776450f-bd45-4b1e-881a-082dd52d65bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:07.131266 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2776450f-bd45-4b1e-881a-082dd52d65bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:07.136976 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2776450f-bd45-4b1e-881a-082dd52d65bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:07.137424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2776450f-bd45-4b1e-881a-082dd52d65bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:07.138177 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2776450f-bd45-4b1e-881a-082dd52d65bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:07.138605 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2776450f-bd45-4b1e-881a-082dd52d65bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:07.199430 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2776450f-bd45-4b1e-881a-082dd52d65bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:07.206916 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2776450f-bd45-4b1e-881a-082dd52d65bb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079969 Jul 19 09:42:07.207495 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 780/1532] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:07 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:07.642522 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0e51a3a5-0041-45bd-aafc-f8b2b8115675 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:07.643187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0e51a3a5-0041-45bd-aafc-f8b2b8115675 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:07.648990 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0e51a3a5-0041-45bd-aafc-f8b2b8115675 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:07.649438 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0e51a3a5-0041-45bd-aafc-f8b2b8115675 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:07.650192 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0e51a3a5-0041-45bd-aafc-f8b2b8115675 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:07.650626 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0e51a3a5-0041-45bd-aafc-f8b2b8115675 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:07.709823 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0e51a3a5-0041-45bd-aafc-f8b2b8115675 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:07.717368 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0e51a3a5-0041-45bd-aafc-f8b2b8115675 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079178 Jul 19 09:42:07.717925 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 753/1533] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:07 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:08.223353 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-659dff63-7db8-40ad-bd17-acf2eec8ac31 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:08.223987 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-659dff63-7db8-40ad-bd17-acf2eec8ac31 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:08.229731 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-659dff63-7db8-40ad-bd17-acf2eec8ac31 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:08.230175 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-659dff63-7db8-40ad-bd17-acf2eec8ac31 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:08.230923 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-659dff63-7db8-40ad-bd17-acf2eec8ac31 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:08.231378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-659dff63-7db8-40ad-bd17-acf2eec8ac31 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:08.290691 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-659dff63-7db8-40ad-bd17-acf2eec8ac31 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:08.298853 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-659dff63-7db8-40ad-bd17-acf2eec8ac31 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079736 Jul 19 09:42:08.299441 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 781/1534] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:08 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:08.733739 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b754619f-77ab-439c-b065-d82ff742e7aa tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:08.734263 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b754619f-77ab-439c-b065-d82ff742e7aa tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:08.740079 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b754619f-77ab-439c-b065-d82ff742e7aa tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:08.740532 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b754619f-77ab-439c-b065-d82ff742e7aa tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:08.741286 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b754619f-77ab-439c-b065-d82ff742e7aa tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:08.741719 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b754619f-77ab-439c-b065-d82ff742e7aa tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:08.800895 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b754619f-77ab-439c-b065-d82ff742e7aa tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:08.808419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b754619f-77ab-439c-b065-d82ff742e7aa tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078405 Jul 19 09:42:08.808976 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 754/1535] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:08 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:09.315724 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-35da3a31-b317-49c4-b457-36d2434604cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:09.316328 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-35da3a31-b317-49c4-b457-36d2434604cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:09.322100 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-35da3a31-b317-49c4-b457-36d2434604cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:09.322546 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-35da3a31-b317-49c4-b457-36d2434604cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:09.323318 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-35da3a31-b317-49c4-b457-36d2434604cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:09.323747 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-35da3a31-b317-49c4-b457-36d2434604cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:09.385410 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-35da3a31-b317-49c4-b457-36d2434604cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:09.392827 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-35da3a31-b317-49c4-b457-36d2434604cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081432 Jul 19 09:42:09.393387 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 782/1536] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:09 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:09.825365 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7b883e49-94ae-4a27-8c45-3485d412a63e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:09.825971 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7b883e49-94ae-4a27-8c45-3485d412a63e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:09.831728 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b883e49-94ae-4a27-8c45-3485d412a63e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:09.832174 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b883e49-94ae-4a27-8c45-3485d412a63e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:09.832925 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b883e49-94ae-4a27-8c45-3485d412a63e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:09.833358 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7b883e49-94ae-4a27-8c45-3485d412a63e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:09.895262 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7b883e49-94ae-4a27-8c45-3485d412a63e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:09.902817 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7b883e49-94ae-4a27-8c45-3485d412a63e tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.081056 Jul 19 09:42:09.903401 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 755/1537] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:09 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:10.409859 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-92252d56-c76a-4c4a-8e4c-775e59656b61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:10.410467 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-92252d56-c76a-4c4a-8e4c-775e59656b61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:10.423408 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-92252d56-c76a-4c4a-8e4c-775e59656b61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:10.423806 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-92252d56-c76a-4c4a-8e4c-775e59656b61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:10.424571 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-92252d56-c76a-4c4a-8e4c-775e59656b61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:10.425044 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-92252d56-c76a-4c4a-8e4c-775e59656b61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:10.484145 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-92252d56-c76a-4c4a-8e4c-775e59656b61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:10.491740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-92252d56-c76a-4c4a-8e4c-775e59656b61 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.086144 Jul 19 09:42:10.492297 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 783/1538] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:10 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:10.919895 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a283a743-de76-4e49-a64f-c2a83ee37741 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:10.920513 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a283a743-de76-4e49-a64f-c2a83ee37741 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:10.926247 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a283a743-de76-4e49-a64f-c2a83ee37741 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:10.926699 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a283a743-de76-4e49-a64f-c2a83ee37741 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:10.927483 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a283a743-de76-4e49-a64f-c2a83ee37741 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:10.927920 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a283a743-de76-4e49-a64f-c2a83ee37741 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:10.987316 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a283a743-de76-4e49-a64f-c2a83ee37741 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:10.994885 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a283a743-de76-4e49-a64f-c2a83ee37741 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078590 Jul 19 09:42:10.995478 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 756/1539] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:10 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:11.508479 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2f4fff6f-8d37-46d7-b051-cb10a285cd86 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:11.509097 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2f4fff6f-8d37-46d7-b051-cb10a285cd86 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:11.514797 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f4fff6f-8d37-46d7-b051-cb10a285cd86 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:11.515296 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f4fff6f-8d37-46d7-b051-cb10a285cd86 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:11.516064 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f4fff6f-8d37-46d7-b051-cb10a285cd86 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:11.516532 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2f4fff6f-8d37-46d7-b051-cb10a285cd86 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:11.575728 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2f4fff6f-8d37-46d7-b051-cb10a285cd86 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:11.583199 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2f4fff6f-8d37-46d7-b051-cb10a285cd86 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078419 Jul 19 09:42:11.583763 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 784/1540] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:11 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:12.011715 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f365d900-f4e5-44c9-ab79-feab148fca31 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:12.012485 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f365d900-f4e5-44c9-ab79-feab148fca31 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:12.018650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f365d900-f4e5-44c9-ab79-feab148fca31 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:12.019120 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f365d900-f4e5-44c9-ab79-feab148fca31 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:12.019872 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f365d900-f4e5-44c9-ab79-feab148fca31 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:12.020299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f365d900-f4e5-44c9-ab79-feab148fca31 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:12.079875 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f365d900-f4e5-44c9-ab79-feab148fca31 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:12.087330 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f365d900-f4e5-44c9-ab79-feab148fca31 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079172 Jul 19 09:42:12.087879 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 757/1541] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:12 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:12.599378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-686e787b-cd9f-42b3-b6bf-6eafe1f732c3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:12.599978 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-686e787b-cd9f-42b3-b6bf-6eafe1f732c3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:12.605899 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-686e787b-cd9f-42b3-b6bf-6eafe1f732c3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:12.606355 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-686e787b-cd9f-42b3-b6bf-6eafe1f732c3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:12.607161 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-686e787b-cd9f-42b3-b6bf-6eafe1f732c3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:12.607601 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-686e787b-cd9f-42b3-b6bf-6eafe1f732c3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:12.667195 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-686e787b-cd9f-42b3-b6bf-6eafe1f732c3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:12.675208 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-686e787b-cd9f-42b3-b6bf-6eafe1f732c3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079466 Jul 19 09:42:12.675766 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 785/1542] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:12 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:13.104335 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-222669bc-818f-4272-a5a6-f5f72415b2e8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:13.104936 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-222669bc-818f-4272-a5a6-f5f72415b2e8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:13.111305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-222669bc-818f-4272-a5a6-f5f72415b2e8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:13.111749 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-222669bc-818f-4272-a5a6-f5f72415b2e8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:13.112504 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-222669bc-818f-4272-a5a6-f5f72415b2e8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:13.112927 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-222669bc-818f-4272-a5a6-f5f72415b2e8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:13.171454 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-222669bc-818f-4272-a5a6-f5f72415b2e8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:13.179685 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-222669bc-818f-4272-a5a6-f5f72415b2e8 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078936 Jul 19 09:42:13.180233 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 758/1543] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:13 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:13.692105 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-49e06e3d-7985-4621-9826-60d8e259fb6f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:13.692719 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-49e06e3d-7985-4621-9826-60d8e259fb6f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:13.698559 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49e06e3d-7985-4621-9826-60d8e259fb6f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:13.699008 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49e06e3d-7985-4621-9826-60d8e259fb6f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:13.699796 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49e06e3d-7985-4621-9826-60d8e259fb6f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:13.700230 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49e06e3d-7985-4621-9826-60d8e259fb6f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:13.761601 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-49e06e3d-7985-4621-9826-60d8e259fb6f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:13.769684 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-49e06e3d-7985-4621-9826-60d8e259fb6f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081692 Jul 19 09:42:13.770239 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 786/1544] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:13 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:14.195679 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7e66bc02-6708-4f9b-b335-a5389d2fa1c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:14.196286 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7e66bc02-6708-4f9b-b335-a5389d2fa1c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:14.202268 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7e66bc02-6708-4f9b-b335-a5389d2fa1c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:14.202709 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7e66bc02-6708-4f9b-b335-a5389d2fa1c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:14.203552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7e66bc02-6708-4f9b-b335-a5389d2fa1c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:14.204021 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7e66bc02-6708-4f9b-b335-a5389d2fa1c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:14.266888 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7e66bc02-6708-4f9b-b335-a5389d2fa1c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:14.274517 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7e66bc02-6708-4f9b-b335-a5389d2fa1c0 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.082430 Jul 19 09:42:14.275095 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 759/1545] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:14 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:14.786725 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-83f648ae-bc81-4674-81e3-4f51c4bb3c99 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:14.787334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-83f648ae-bc81-4674-81e3-4f51c4bb3c99 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:14.793327 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-83f648ae-bc81-4674-81e3-4f51c4bb3c99 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:14.793774 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-83f648ae-bc81-4674-81e3-4f51c4bb3c99 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:14.794529 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-83f648ae-bc81-4674-81e3-4f51c4bb3c99 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:14.794961 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-83f648ae-bc81-4674-81e3-4f51c4bb3c99 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:14.853774 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-83f648ae-bc81-4674-81e3-4f51c4bb3c99 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:14.861225 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-83f648ae-bc81-4674-81e3-4f51c4bb3c99 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078217 Jul 19 09:42:14.861780 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 787/1546] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:14 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:15.291201 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2a839238-f363-41b5-9658-7869d788e696 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:15.291802 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2a839238-f363-41b5-9658-7869d788e696 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:15.298094 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2a839238-f363-41b5-9658-7869d788e696 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:15.298544 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2a839238-f363-41b5-9658-7869d788e696 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:15.299316 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2a839238-f363-41b5-9658-7869d788e696 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:15.299745 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2a839238-f363-41b5-9658-7869d788e696 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:15.357854 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2a839238-f363-41b5-9658-7869d788e696 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:15.365919 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2a839238-f363-41b5-9658-7869d788e696 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.078649 Jul 19 09:42:15.366469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 760/1547] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:15 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:15.878106 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5db88d4f-3119-4fdc-b37d-41613bfe3332 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:15.878717 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5db88d4f-3119-4fdc-b37d-41613bfe3332 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:15.884513 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5db88d4f-3119-4fdc-b37d-41613bfe3332 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:15.884964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5db88d4f-3119-4fdc-b37d-41613bfe3332 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:15.885718 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5db88d4f-3119-4fdc-b37d-41613bfe3332 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:15.886148 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5db88d4f-3119-4fdc-b37d-41613bfe3332 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:15.945162 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5db88d4f-3119-4fdc-b37d-41613bfe3332 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:15.952654 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5db88d4f-3119-4fdc-b37d-41613bfe3332 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078849 Jul 19 09:42:15.953209 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 788/1548] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:15 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:16.382589 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-139bb903-db07-4c33-b942-2f50148ead4a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:16.383214 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-139bb903-db07-4c33-b942-2f50148ead4a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:16.389070 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-139bb903-db07-4c33-b942-2f50148ead4a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:16.389511 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-139bb903-db07-4c33-b942-2f50148ead4a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:16.390268 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-139bb903-db07-4c33-b942-2f50148ead4a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:16.390695 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-139bb903-db07-4c33-b942-2f50148ead4a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:16.450879 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-139bb903-db07-4c33-b942-2f50148ead4a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:16.458819 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-139bb903-db07-4c33-b942-2f50148ead4a tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.079866 Jul 19 09:42:16.459416 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 761/1549] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:16 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:16.968961 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d0333f79-d6d9-4d4c-84fc-07aabfc4eadf tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:16.969556 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d0333f79-d6d9-4d4c-84fc-07aabfc4eadf tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:16.975394 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d0333f79-d6d9-4d4c-84fc-07aabfc4eadf tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:16.975841 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d0333f79-d6d9-4d4c-84fc-07aabfc4eadf tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:16.976597 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d0333f79-d6d9-4d4c-84fc-07aabfc4eadf tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:16.977028 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d0333f79-d6d9-4d4c-84fc-07aabfc4eadf tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:17.035685 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d0333f79-d6d9-4d4c-84fc-07aabfc4eadf tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:17.043448 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d0333f79-d6d9-4d4c-84fc-07aabfc4eadf tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078138 Jul 19 09:42:17.044003 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 789/1550] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:16 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:17.475102 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-63f1bbd9-d75d-4478-8ec1-646e2b500fb5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:17.475714 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-63f1bbd9-d75d-4478-8ec1-646e2b500fb5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:17.481556 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-63f1bbd9-d75d-4478-8ec1-646e2b500fb5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:17.482004 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-63f1bbd9-d75d-4478-8ec1-646e2b500fb5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:17.482754 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-63f1bbd9-d75d-4478-8ec1-646e2b500fb5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:17.483214 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-63f1bbd9-d75d-4478-8ec1-646e2b500fb5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:17.543330 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-63f1bbd9-d75d-4478-8ec1-646e2b500fb5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3e6c648a43ba91287cda79019993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3197460e0e344400b48795ca25fbd373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:17.551526 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-63f1bbd9-d75d-4478-8ec1-646e2b500fb5 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 200 len: 1350 microversion: 2.1 time: 0.080060 Jul 19 09:42:17.552088 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 762/1551] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:17 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:18.060333 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ec202170-f8cc-4f92-8e57-41370549392b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:18.060935 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ec202170-f8cc-4f92-8e57-41370549392b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:18.067269 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ec202170-f8cc-4f92-8e57-41370549392b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:18.067714 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ec202170-f8cc-4f92-8e57-41370549392b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:18.068480 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ec202170-f8cc-4f92-8e57-41370549392b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:18.068909 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ec202170-f8cc-4f92-8e57-41370549392b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:18.143662 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ec202170-f8cc-4f92-8e57-41370549392b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:18.161725 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ec202170-f8cc-4f92-8e57-41370549392b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.105000 Jul 19 09:42:18.162638 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 790/1552] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:18 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:18.176280 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c5322125-5e93-4295-b745-89e51a9427ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:18.176767 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c5322125-5e93-4295-b745-89e51a9427ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:18.182734 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c5322125-5e93-4295-b745-89e51a9427ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:18.183813 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c5322125-5e93-4295-b745-89e51a9427ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:18.184421 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c5322125-5e93-4295-b745-89e51a9427ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:18.184849 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c5322125-5e93-4295-b745-89e51a9427ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:18.215198 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c5322125-5e93-4295-b745-89e51a9427ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Going to try to terminate instance {{(pid=107464) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:42:18.231647 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-fabac9a1-b0d4-4e23-afbe-5308842a7d87 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:18.232223 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-fabac9a1-b0d4-4e23-afbe-5308842a7d87 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:18.238815 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fabac9a1-b0d4-4e23-afbe-5308842a7d87 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:18.239523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fabac9a1-b0d4-4e23-afbe-5308842a7d87 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:18.240522 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fabac9a1-b0d4-4e23-afbe-5308842a7d87 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:18.241145 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fabac9a1-b0d4-4e23-afbe-5308842a7d87 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:18.268217 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-fabac9a1-b0d4-4e23-afbe-5308842a7d87 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Going to try to terminate instance {{(pid=107463) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:42:18.322175 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c5322125-5e93-4295-b745-89e51a9427ea tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99" status: 204 len: 0 microversion: 2.20 time: 0.149584 Jul 19 09:42:18.322777 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 763/1553] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Jul 19 09:42:18 2021] DELETE /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 09:42:18.331013 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fc97640a-d856-4a8a-8a3f-9e048365e0fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:18.331739 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fc97640a-d856-4a8a-8a3f-9e048365e0fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:18.337437 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc97640a-d856-4a8a-8a3f-9e048365e0fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:18.337893 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc97640a-d856-4a8a-8a3f-9e048365e0fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:18.338666 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc97640a-d856-4a8a-8a3f-9e048365e0fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:18.339161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc97640a-d856-4a8a-8a3f-9e048365e0fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:18.349288 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-fabac9a1-b0d4-4e23-afbe-5308842a7d87 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 204 len: 0 microversion: 2.1 time: 0.120832 Jul 19 09:42:18.349996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 791/1554] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:42:18 2021] DELETE /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 09:42:18.358366 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-43ce5564-3328-4259-8066-915f4e61a5c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:18.359100 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-43ce5564-3328-4259-8066-915f4e61a5c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:18.365325 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-43ce5564-3328-4259-8066-915f4e61a5c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:18.365767 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-43ce5564-3328-4259-8066-915f4e61a5c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:18.366657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-43ce5564-3328-4259-8066-915f4e61a5c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:18.367104 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-43ce5564-3328-4259-8066-915f4e61a5c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:18.479206 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fc97640a-d856-4a8a-8a3f-9e048365e0fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:18.487672 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fc97640a-d856-4a8a-8a3f-9e048365e0fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:18.489226 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fc97640a-d856-4a8a-8a3f-9e048365e0fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:18.490395 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fc97640a-d856-4a8a-8a3f-9e048365e0fd tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99" status: 200 len: 1723 microversion: 2.20 time: 0.163341 Jul 19 09:42:18.490958 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 764/1555] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:42:18 2021] GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 09:42:18.503784 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-43ce5564-3328-4259-8066-915f4e61a5c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:18.511541 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-43ce5564-3328-4259-8066-915f4e61a5c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1557 microversion: 2.1 time: 0.157254 Jul 19 09:42:18.512099 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 792/1556] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:18 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:42:18.568197 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bb77d1c2-81f3-4c7c-8170-3ea9d64a3b52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:18.568808 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bb77d1c2-81f3-4c7c-8170-3ea9d64a3b52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] [instance: 36be7eb9-715d-4855-9896-49929b6d5013] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:18.574621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bb77d1c2-81f3-4c7c-8170-3ea9d64a3b52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:18.575008 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bb77d1c2-81f3-4c7c-8170-3ea9d64a3b52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:18.575797 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bb77d1c2-81f3-4c7c-8170-3ea9d64a3b52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:18.576230 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bb77d1c2-81f3-4c7c-8170-3ea9d64a3b52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:18.589597 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-bb77d1c2-81f3-4c7c-8170-3ea9d64a3b52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] HTTP exception thrown: Instance 36be7eb9-715d-4855-9896-49929b6d5013 could not be found. Jul 19 09:42:18.590174 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bb77d1c2-81f3-4c7c-8170-3ea9d64a3b52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] Returning 404 to user: Instance 36be7eb9-715d-4855-9896-49929b6d5013 could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:42:18.590996 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bb77d1c2-81f3-4c7c-8170-3ea9d64a3b52 tempest-VolumesSnapshotTestJSON-2021845794 tempest-VolumesSnapshotTestJSON-2021845794-project] 10.222.0.16 "GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013" status: 404 len: 111 microversion: 2.1 time: 0.026499 Jul 19 09:42:18.591533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 765/1557] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:18 2021] GET /compute/v2.1/servers/36be7eb9-715d-4855-9896-49929b6d5013 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:42:19.178742 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-59ab4b3f-aeb4-4791-ba37-d98a5581407a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:19.179491 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-59ab4b3f-aeb4-4791-ba37-d98a5581407a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:19.185518 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-59ab4b3f-aeb4-4791-ba37-d98a5581407a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:19.186038 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-59ab4b3f-aeb4-4791-ba37-d98a5581407a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:19.186869 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-59ab4b3f-aeb4-4791-ba37-d98a5581407a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:19.187411 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-59ab4b3f-aeb4-4791-ba37-d98a5581407a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:19.248098 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-59ab4b3f-aeb4-4791-ba37-d98a5581407a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:19.256825 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-59ab4b3f-aeb4-4791-ba37-d98a5581407a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081704 Jul 19 09:42:19.257847 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 793/1558] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:19 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:19.509653 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-98266f5d-088d-4f9a-b4b5-0e48ed37c49c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:19.510259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-98266f5d-088d-4f9a-b4b5-0e48ed37c49c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:19.516075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98266f5d-088d-4f9a-b4b5-0e48ed37c49c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:19.516522 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98266f5d-088d-4f9a-b4b5-0e48ed37c49c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:19.517283 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98266f5d-088d-4f9a-b4b5-0e48ed37c49c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:19.517714 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-98266f5d-088d-4f9a-b4b5-0e48ed37c49c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:19.528526 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0e683468-06b2-4d9a-ae71-2725918d708f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:19.529135 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0e683468-06b2-4d9a-ae71-2725918d708f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:19.534831 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0e683468-06b2-4d9a-ae71-2725918d708f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:19.535306 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0e683468-06b2-4d9a-ae71-2725918d708f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:19.536388 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0e683468-06b2-4d9a-ae71-2725918d708f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:19.536819 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0e683468-06b2-4d9a-ae71-2725918d708f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:19.628208 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-98266f5d-088d-4f9a-b4b5-0e48ed37c49c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:19.636087 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-98266f5d-088d-4f9a-b4b5-0e48ed37c49c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:19.637599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-98266f5d-088d-4f9a-b4b5-0e48ed37c49c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96ccfe87d4084f299d97fa417b248d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498b582b7bb4eca8ff9411d45786967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:19.638724 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-98266f5d-088d-4f9a-b4b5-0e48ed37c49c tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99" status: 200 len: 1656 microversion: 2.20 time: 0.133145 Jul 19 09:42:19.639294 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 766/1559] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:42:19 2021] GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 => generated 1656 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 09:42:19.680610 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0e683468-06b2-4d9a-ae71-2725918d708f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:19.688929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0e683468-06b2-4d9a-ae71-2725918d708f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1557 microversion: 2.1 time: 0.163991 Jul 19 09:42:19.689571 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 794/1560] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:19 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1557 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:42:19.948624 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-2d318e5d-654d-49f4-93a1-a5338f2a7975 req-27d2d1d1-5d82-4982-b0b8-b5c645278443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5684c14-21c0-4aeb-9ca6-9df7ae3111f8", "name": "network-vif-deleted", "tag": "16feefe3-38f0-490f-bae0-554b20fb320b"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:42:19.950530 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:42:19.950530 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:42:19.959881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-2d318e5d-654d-49f4-93a1-a5338f2a7975 req-27d2d1d1-5d82-4982-b0b8-b5c645278443 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:19.959881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-2d318e5d-654d-49f4-93a1-a5338f2a7975 req-27d2d1d1-5d82-4982-b0b8-b5c645278443 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:19.997704 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-2d318e5d-654d-49f4-93a1-a5338f2a7975 req-27d2d1d1-5d82-4982-b0b8-b5c645278443 service nova] Creating event network-vif-deleted:16feefe3-38f0-490f-bae0-554b20fb320b for instance a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 on hv-cinder-79338 Jul 19 09:42:20.003356 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-2d318e5d-654d-49f4-93a1-a5338f2a7975 req-27d2d1d1-5d82-4982-b0b8-b5c645278443 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058944 Jul 19 09:42:20.004559 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 767/1561] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:42:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:42:20.273088 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c22afc0a-ad02-45c9-9649-f99838d33b70 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:20.273696 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c22afc0a-ad02-45c9-9649-f99838d33b70 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:20.279333 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c22afc0a-ad02-45c9-9649-f99838d33b70 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:20.279828 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c22afc0a-ad02-45c9-9649-f99838d33b70 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:20.280557 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c22afc0a-ad02-45c9-9649-f99838d33b70 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:20.280986 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c22afc0a-ad02-45c9-9649-f99838d33b70 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:20.341244 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c22afc0a-ad02-45c9-9649-f99838d33b70 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:20.351316 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c22afc0a-ad02-45c9-9649-f99838d33b70 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081786 Jul 19 09:42:20.351911 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 795/1562] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:20 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:20.657881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2250b5dd-8815-4022-b3fd-f4995e5e68c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:20.658751 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2250b5dd-8815-4022-b3fd-f4995e5e68c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:20.665328 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2250b5dd-8815-4022-b3fd-f4995e5e68c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:20.665808 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2250b5dd-8815-4022-b3fd-f4995e5e68c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:20.666758 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2250b5dd-8815-4022-b3fd-f4995e5e68c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:20.667223 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2250b5dd-8815-4022-b3fd-f4995e5e68c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:20.680746 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-2250b5dd-8815-4022-b3fd-f4995e5e68c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] HTTP exception thrown: Instance 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 could not be found. Jul 19 09:42:20.681569 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2250b5dd-8815-4022-b3fd-f4995e5e68c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Returning 404 to user: Instance 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:42:20.682390 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2250b5dd-8815-4022-b3fd-f4995e5e68c6 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99" status: 404 len: 111 microversion: 2.20 time: 0.029285 Jul 19 09:42:20.682925 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 768/1563] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 19 09:42:20 2021] GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 09:42:20.691424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-26c6b84e-d393-4ca1-8244-68740078f8ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '.version_select at 0x7f04b01d15e0>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:20.705280 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-18cf30d0-8f10-4540-aae3-0ed81dacd4ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:20.706073 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-18cf30d0-8f10-4540-aae3-0ed81dacd4ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:20.712075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-18cf30d0-8f10-4540-aae3-0ed81dacd4ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:20.712533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-18cf30d0-8f10-4540-aae3-0ed81dacd4ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:20.713672 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-18cf30d0-8f10-4540-aae3-0ed81dacd4ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:20.713801 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-18cf30d0-8f10-4540-aae3-0ed81dacd4ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:20.715125 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-26c6b84e-d393-4ca1-8244-68740078f8ec tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105244001" status: 204 len: 0 microversion: 2.20 time: 0.027166 Jul 19 09:42:20.719837 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 796/1564] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Jul 19 09:42:20 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105244001 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 09:42:20.787692 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-18cf30d0-8f10-4540-aae3-0ed81dacd4ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:20.796804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-18cf30d0-8f10-4540-aae3-0ed81dacd4ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.095027 Jul 19 09:42:20.804391 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 769/1565] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:20 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:42:21.367539 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6c82c286-4a3d-4f04-bd8f-8f59d0b7773c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:21.368302 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6c82c286-4a3d-4f04-bd8f-8f59d0b7773c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:21.374237 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c82c286-4a3d-4f04-bd8f-8f59d0b7773c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:21.374681 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c82c286-4a3d-4f04-bd8f-8f59d0b7773c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:21.376035 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c82c286-4a3d-4f04-bd8f-8f59d0b7773c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:21.376462 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6c82c286-4a3d-4f04-bd8f-8f59d0b7773c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:21.440256 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6c82c286-4a3d-4f04-bd8f-8f59d0b7773c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:21.447707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6c82c286-4a3d-4f04-bd8f-8f59d0b7773c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.083851 Jul 19 09:42:21.448257 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 797/1566] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:21 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:21.813559 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c9c3222b-2a99-41d5-b2ba-134301c48525 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:21.814159 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c9c3222b-2a99-41d5-b2ba-134301c48525 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:21.819930 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c9c3222b-2a99-41d5-b2ba-134301c48525 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:21.820371 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c9c3222b-2a99-41d5-b2ba-134301c48525 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:21.821124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c9c3222b-2a99-41d5-b2ba-134301c48525 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:21.821551 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c9c3222b-2a99-41d5-b2ba-134301c48525 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:21.880842 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c9c3222b-2a99-41d5-b2ba-134301c48525 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:21.888674 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c9c3222b-2a99-41d5-b2ba-134301c48525 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078756 Jul 19 09:42:21.889235 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 770/1567] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:21 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:22.033647 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-8a1afbf9-3978-4b82-bb98-00b2754579a2 req-72ba92b6-54a6-4a22-aebe-341b29d25d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc900d8-8c3c-429b-953a-e2bcb0ef6d99", "name": "network-vif-deleted", "tag": "06bb4f5b-08f4-4c1e-870c-960b0cc83027"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:42:22.035168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:42:22.035168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:42:22.042215 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-8a1afbf9-3978-4b82-bb98-00b2754579a2 req-72ba92b6-54a6-4a22-aebe-341b29d25d34 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:22.042651 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-8a1afbf9-3978-4b82-bb98-00b2754579a2 req-72ba92b6-54a6-4a22-aebe-341b29d25d34 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:22.052758 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-8a1afbf9-3978-4b82-bb98-00b2754579a2 req-72ba92b6-54a6-4a22-aebe-341b29d25d34 service nova] Creating event network-vif-deleted:06bb4f5b-08f4-4c1e-870c-960b0cc83027 for instance 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 on hv-cinder-79338 Jul 19 09:42:22.057533 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-8a1afbf9-3978-4b82-bb98-00b2754579a2 req-72ba92b6-54a6-4a22-aebe-341b29d25d34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027488 Jul 19 09:42:22.058131 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 798/1568] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:42:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 09:42:22.464636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c7a33d6e-37e2-4eb5-8f1f-a59460b797f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:22.465276 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c7a33d6e-37e2-4eb5-8f1f-a59460b797f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:22.471941 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7a33d6e-37e2-4eb5-8f1f-a59460b797f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:22.472389 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7a33d6e-37e2-4eb5-8f1f-a59460b797f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:22.473217 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7a33d6e-37e2-4eb5-8f1f-a59460b797f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:22.473686 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7a33d6e-37e2-4eb5-8f1f-a59460b797f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:22.538251 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c7a33d6e-37e2-4eb5-8f1f-a59460b797f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:22.546294 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c7a33d6e-37e2-4eb5-8f1f-a59460b797f8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.085313 Jul 19 09:42:22.546859 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 771/1569] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:22 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:22.905933 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e97dab6b-fa2b-4408-b510-f58cdf695860 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:22.907061 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e97dab6b-fa2b-4408-b510-f58cdf695860 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:22.913033 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e97dab6b-fa2b-4408-b510-f58cdf695860 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:22.913485 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e97dab6b-fa2b-4408-b510-f58cdf695860 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:22.914251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e97dab6b-fa2b-4408-b510-f58cdf695860 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:22.914947 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e97dab6b-fa2b-4408-b510-f58cdf695860 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:22.974514 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e97dab6b-fa2b-4408-b510-f58cdf695860 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:22.982028 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e97dab6b-fa2b-4408-b510-f58cdf695860 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.080245 Jul 19 09:42:22.982586 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 799/1570] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:22 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:23.562503 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3e4bbac9-2f03-43f2-a5d2-d89c7f33c42e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:23.563074 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3e4bbac9-2f03-43f2-a5d2-d89c7f33c42e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:23.569002 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e4bbac9-2f03-43f2-a5d2-d89c7f33c42e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:23.569455 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e4bbac9-2f03-43f2-a5d2-d89c7f33c42e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:23.570252 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e4bbac9-2f03-43f2-a5d2-d89c7f33c42e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:23.570687 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3e4bbac9-2f03-43f2-a5d2-d89c7f33c42e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:23.629664 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3e4bbac9-2f03-43f2-a5d2-d89c7f33c42e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:23.637199 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3e4bbac9-2f03-43f2-a5d2-d89c7f33c42e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078457 Jul 19 09:42:23.637757 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 772/1571] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:23 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:23.998783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b959e75d-80ce-47ca-badf-6c97a87d165c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:23.999420 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b959e75d-80ce-47ca-badf-6c97a87d165c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:24.005829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b959e75d-80ce-47ca-badf-6c97a87d165c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:24.006279 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b959e75d-80ce-47ca-badf-6c97a87d165c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:24.007054 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b959e75d-80ce-47ca-badf-6c97a87d165c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:24.007487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b959e75d-80ce-47ca-badf-6c97a87d165c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:24.066643 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b959e75d-80ce-47ca-badf-6c97a87d165c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:24.074227 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b959e75d-80ce-47ca-badf-6c97a87d165c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079065 Jul 19 09:42:24.074782 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 800/1572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:23 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:24.653645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-927c7984-3e42-4517-810f-65928d6c3001 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:24.654286 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-927c7984-3e42-4517-810f-65928d6c3001 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:24.660704 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-927c7984-3e42-4517-810f-65928d6c3001 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:24.661160 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-927c7984-3e42-4517-810f-65928d6c3001 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:24.661923 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-927c7984-3e42-4517-810f-65928d6c3001 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:24.662357 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-927c7984-3e42-4517-810f-65928d6c3001 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:24.722523 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-927c7984-3e42-4517-810f-65928d6c3001 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:24.730067 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-927c7984-3e42-4517-810f-65928d6c3001 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.080113 Jul 19 09:42:24.730634 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 773/1573] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:24 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:25.090258 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d8754ab7-834c-43c7-ac05-5d4c7640a09d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:25.090792 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d8754ab7-834c-43c7-ac05-5d4c7640a09d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:25.096497 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d8754ab7-834c-43c7-ac05-5d4c7640a09d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:25.096942 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d8754ab7-834c-43c7-ac05-5d4c7640a09d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:25.097721 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d8754ab7-834c-43c7-ac05-5d4c7640a09d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:25.098151 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d8754ab7-834c-43c7-ac05-5d4c7640a09d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:25.157084 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d8754ab7-834c-43c7-ac05-5d4c7640a09d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:25.165212 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d8754ab7-834c-43c7-ac05-5d4c7640a09d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078326 Jul 19 09:42:25.165829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 801/1574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:25 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:25.746708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1153201b-4b41-496e-915a-a7694121e308 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:25.747345 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1153201b-4b41-496e-915a-a7694121e308 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:25.753195 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1153201b-4b41-496e-915a-a7694121e308 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:25.753646 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1153201b-4b41-496e-915a-a7694121e308 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:25.754411 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1153201b-4b41-496e-915a-a7694121e308 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:25.754849 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1153201b-4b41-496e-915a-a7694121e308 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:25.814165 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1153201b-4b41-496e-915a-a7694121e308 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:25.821654 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1153201b-4b41-496e-915a-a7694121e308 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078651 Jul 19 09:42:25.822208 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 774/1575] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:25 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:26.181340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0ad61d5f-3572-443e-b71f-da3cebb841db tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:26.181943 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0ad61d5f-3572-443e-b71f-da3cebb841db tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:26.187872 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0ad61d5f-3572-443e-b71f-da3cebb841db tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:26.188462 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0ad61d5f-3572-443e-b71f-da3cebb841db tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:26.189226 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0ad61d5f-3572-443e-b71f-da3cebb841db tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:26.189687 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0ad61d5f-3572-443e-b71f-da3cebb841db tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:26.251662 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0ad61d5f-3572-443e-b71f-da3cebb841db tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:26.259389 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0ad61d5f-3572-443e-b71f-da3cebb841db tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.081670 Jul 19 09:42:26.259950 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 802/1576] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:26 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:26.838077 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-25279f03-7691-48dc-83b2-1ca37e545905 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:26.838601 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-25279f03-7691-48dc-83b2-1ca37e545905 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:26.844418 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-25279f03-7691-48dc-83b2-1ca37e545905 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:26.844869 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-25279f03-7691-48dc-83b2-1ca37e545905 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:26.845634 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-25279f03-7691-48dc-83b2-1ca37e545905 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:26.846068 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-25279f03-7691-48dc-83b2-1ca37e545905 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:26.908258 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-25279f03-7691-48dc-83b2-1ca37e545905 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:26.916062 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-25279f03-7691-48dc-83b2-1ca37e545905 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081720 Jul 19 09:42:26.916617 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 775/1577] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:26 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:27.276149 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-53731f34-309b-4261-b093-b98ebf46d201 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:27.276780 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-53731f34-309b-4261-b093-b98ebf46d201 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:27.283081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-53731f34-309b-4261-b093-b98ebf46d201 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:27.283536 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-53731f34-309b-4261-b093-b98ebf46d201 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:27.284297 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-53731f34-309b-4261-b093-b98ebf46d201 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:27.284735 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-53731f34-309b-4261-b093-b98ebf46d201 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:27.342912 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-53731f34-309b-4261-b093-b98ebf46d201 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:27.350919 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-53731f34-309b-4261-b093-b98ebf46d201 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078474 Jul 19 09:42:27.351507 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 803/1578] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:27 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:27.933173 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e3e1b86c-f69e-4ec1-90c9-37e8b682d7eb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:27.933809 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e3e1b86c-f69e-4ec1-90c9-37e8b682d7eb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:27.940289 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e3e1b86c-f69e-4ec1-90c9-37e8b682d7eb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:27.940741 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e3e1b86c-f69e-4ec1-90c9-37e8b682d7eb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:27.941495 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e3e1b86c-f69e-4ec1-90c9-37e8b682d7eb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:27.941927 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e3e1b86c-f69e-4ec1-90c9-37e8b682d7eb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:28.002239 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e3e1b86c-f69e-4ec1-90c9-37e8b682d7eb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:28.009721 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e3e1b86c-f69e-4ec1-90c9-37e8b682d7eb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.080214 Jul 19 09:42:28.010274 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 776/1579] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:27 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:28.367910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-382a32f1-c3af-4c9d-86db-1488348654fc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:28.368433 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-382a32f1-c3af-4c9d-86db-1488348654fc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:28.374175 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-382a32f1-c3af-4c9d-86db-1488348654fc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:28.374627 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-382a32f1-c3af-4c9d-86db-1488348654fc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:28.375968 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-382a32f1-c3af-4c9d-86db-1488348654fc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:28.376401 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-382a32f1-c3af-4c9d-86db-1488348654fc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:28.435463 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-382a32f1-c3af-4c9d-86db-1488348654fc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:28.443609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-382a32f1-c3af-4c9d-86db-1488348654fc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079419 Jul 19 09:42:28.444242 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 804/1580] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:28 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:29.026441 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0ca5cbf9-82b6-4654-bcb7-d1a6affd5717 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:29.027025 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0ca5cbf9-82b6-4654-bcb7-d1a6affd5717 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:29.033348 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0ca5cbf9-82b6-4654-bcb7-d1a6affd5717 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:29.033795 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0ca5cbf9-82b6-4654-bcb7-d1a6affd5717 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:29.034554 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0ca5cbf9-82b6-4654-bcb7-d1a6affd5717 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:29.034987 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0ca5cbf9-82b6-4654-bcb7-d1a6affd5717 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:29.095540 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0ca5cbf9-82b6-4654-bcb7-d1a6affd5717 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:29.103473 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0ca5cbf9-82b6-4654-bcb7-d1a6affd5717 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.080564 Jul 19 09:42:29.104032 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 777/1581] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:29 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:29.460133 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1237e046-5056-4e91-bfe3-e5dcf444c149 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:29.460755 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1237e046-5056-4e91-bfe3-e5dcf444c149 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:29.466474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1237e046-5056-4e91-bfe3-e5dcf444c149 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:29.466922 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1237e046-5056-4e91-bfe3-e5dcf444c149 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:29.467712 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1237e046-5056-4e91-bfe3-e5dcf444c149 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:29.468145 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1237e046-5056-4e91-bfe3-e5dcf444c149 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:29.526663 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1237e046-5056-4e91-bfe3-e5dcf444c149 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:29.534165 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1237e046-5056-4e91-bfe3-e5dcf444c149 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.077655 Jul 19 09:42:29.534721 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 805/1582] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:29 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:30.120538 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-057b2ce3-3fc2-44aa-949d-74bb03951d39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:30.121142 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-057b2ce3-3fc2-44aa-949d-74bb03951d39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:30.127486 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-057b2ce3-3fc2-44aa-949d-74bb03951d39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:30.127926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-057b2ce3-3fc2-44aa-949d-74bb03951d39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:30.128752 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-057b2ce3-3fc2-44aa-949d-74bb03951d39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:30.129184 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-057b2ce3-3fc2-44aa-949d-74bb03951d39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:30.189380 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-057b2ce3-3fc2-44aa-949d-74bb03951d39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:30.196888 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-057b2ce3-3fc2-44aa-949d-74bb03951d39 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.080001 Jul 19 09:42:30.197435 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 778/1583] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:30 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:30.549986 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5f87609b-d734-4149-8aef-57066b0b8614 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:30.550599 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5f87609b-d734-4149-8aef-57066b0b8614 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:30.556409 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f87609b-d734-4149-8aef-57066b0b8614 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:30.556859 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f87609b-d734-4149-8aef-57066b0b8614 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:30.557625 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f87609b-d734-4149-8aef-57066b0b8614 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:30.558061 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5f87609b-d734-4149-8aef-57066b0b8614 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:30.620039 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5f87609b-d734-4149-8aef-57066b0b8614 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:30.627641 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5f87609b-d734-4149-8aef-57066b0b8614 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.081360 Jul 19 09:42:30.628207 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 806/1584] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:30 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:42:31.213236 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6ae27147-1919-465f-9e61-cfc64ace13f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:31.213840 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6ae27147-1919-465f-9e61-cfc64ace13f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:31.219504 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ae27147-1919-465f-9e61-cfc64ace13f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:31.219949 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ae27147-1919-465f-9e61-cfc64ace13f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:31.220700 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ae27147-1919-465f-9e61-cfc64ace13f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:31.221143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ae27147-1919-465f-9e61-cfc64ace13f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:31.283690 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6ae27147-1919-465f-9e61-cfc64ace13f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:31.291573 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6ae27147-1919-465f-9e61-cfc64ace13f7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081986 Jul 19 09:42:31.292128 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 779/1585] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:31 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:31.643847 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-97cabca7-94eb-4b09-98a9-b8642f7bb822 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:31.644386 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-97cabca7-94eb-4b09-98a9-b8642f7bb822 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:31.650126 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-97cabca7-94eb-4b09-98a9-b8642f7bb822 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:31.650613 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-97cabca7-94eb-4b09-98a9-b8642f7bb822 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:31.651402 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-97cabca7-94eb-4b09-98a9-b8642f7bb822 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:31.651839 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-97cabca7-94eb-4b09-98a9-b8642f7bb822 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:31.710814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-97cabca7-94eb-4b09-98a9-b8642f7bb822 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:31.718272 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-97cabca7-94eb-4b09-98a9-b8642f7bb822 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078166 Jul 19 09:42:31.718830 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 807/1586] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:31 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:32.308410 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fb153a84-a43b-478c-b9d1-c4d168d04192 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:32.309014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fb153a84-a43b-478c-b9d1-c4d168d04192 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:32.314764 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fb153a84-a43b-478c-b9d1-c4d168d04192 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:32.315249 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fb153a84-a43b-478c-b9d1-c4d168d04192 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:32.316002 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fb153a84-a43b-478c-b9d1-c4d168d04192 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:32.316435 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fb153a84-a43b-478c-b9d1-c4d168d04192 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:32.375246 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-fb153a84-a43b-478c-b9d1-c4d168d04192 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:32.383230 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fb153a84-a43b-478c-b9d1-c4d168d04192 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078543 Jul 19 09:42:32.383784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 780/1587] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:32 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:32.735267 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f59b64fb-0900-46f5-a463-33b2c1bdfb2f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:32.735805 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f59b64fb-0900-46f5-a463-33b2c1bdfb2f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:32.741896 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f59b64fb-0900-46f5-a463-33b2c1bdfb2f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:32.742343 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f59b64fb-0900-46f5-a463-33b2c1bdfb2f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:32.743129 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f59b64fb-0900-46f5-a463-33b2c1bdfb2f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:32.743565 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f59b64fb-0900-46f5-a463-33b2c1bdfb2f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:32.802566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f59b64fb-0900-46f5-a463-33b2c1bdfb2f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:32.810091 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f59b64fb-0900-46f5-a463-33b2c1bdfb2f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078546 Jul 19 09:42:32.810652 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 808/1588] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:32 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:33.399786 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-be5bb4fc-ac00-4dd9-8d05-6ba2f235ac46 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:33.400389 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-be5bb4fc-ac00-4dd9-8d05-6ba2f235ac46 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:33.406043 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be5bb4fc-ac00-4dd9-8d05-6ba2f235ac46 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:33.406487 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be5bb4fc-ac00-4dd9-8d05-6ba2f235ac46 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:33.407270 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be5bb4fc-ac00-4dd9-8d05-6ba2f235ac46 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:33.408197 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be5bb4fc-ac00-4dd9-8d05-6ba2f235ac46 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:33.467658 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-be5bb4fc-ac00-4dd9-8d05-6ba2f235ac46 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:33.475578 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-be5bb4fc-ac00-4dd9-8d05-6ba2f235ac46 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079641 Jul 19 09:42:33.476163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 781/1589] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:33 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:33.826387 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-23a5a619-d299-4749-a836-f2ab36663b41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:33.826959 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-23a5a619-d299-4749-a836-f2ab36663b41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:33.833280 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-23a5a619-d299-4749-a836-f2ab36663b41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:33.833733 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-23a5a619-d299-4749-a836-f2ab36663b41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:33.834499 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-23a5a619-d299-4749-a836-f2ab36663b41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:33.834936 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-23a5a619-d299-4749-a836-f2ab36663b41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:33.894432 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-23a5a619-d299-4749-a836-f2ab36663b41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:33.902335 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-23a5a619-d299-4749-a836-f2ab36663b41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079669 Jul 19 09:42:33.902896 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 809/1590] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:33 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:42:34.492320 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-772e0b80-1fb4-4e66-b9d3-a9bf2577fb9b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:34.492933 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-772e0b80-1fb4-4e66-b9d3-a9bf2577fb9b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:34.498684 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-772e0b80-1fb4-4e66-b9d3-a9bf2577fb9b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:34.499167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-772e0b80-1fb4-4e66-b9d3-a9bf2577fb9b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:34.499926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-772e0b80-1fb4-4e66-b9d3-a9bf2577fb9b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:34.500360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-772e0b80-1fb4-4e66-b9d3-a9bf2577fb9b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:34.560765 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-772e0b80-1fb4-4e66-b9d3-a9bf2577fb9b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:34.569075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-772e0b80-1fb4-4e66-b9d3-a9bf2577fb9b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.080396 Jul 19 09:42:34.569636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 782/1591] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:34 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:34.918831 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-18be5049-ffb3-4779-96d6-0d5ee8a3f3bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:34.919463 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-18be5049-ffb3-4779-96d6-0d5ee8a3f3bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:34.925875 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-18be5049-ffb3-4779-96d6-0d5ee8a3f3bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:34.926314 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-18be5049-ffb3-4779-96d6-0d5ee8a3f3bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:34.927081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-18be5049-ffb3-4779-96d6-0d5ee8a3f3bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:34.927511 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-18be5049-ffb3-4779-96d6-0d5ee8a3f3bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:34.989237 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-18be5049-ffb3-4779-96d6-0d5ee8a3f3bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:34.996819 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-18be5049-ffb3-4779-96d6-0d5ee8a3f3bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.081840 Jul 19 09:42:34.997378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 810/1592] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:34 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:35.586160 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8d5fc780-6fe6-45e6-aecd-543a1f772a17 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:35.586770 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8d5fc780-6fe6-45e6-aecd-543a1f772a17 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:35.592642 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8d5fc780-6fe6-45e6-aecd-543a1f772a17 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:35.593098 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8d5fc780-6fe6-45e6-aecd-543a1f772a17 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:35.593860 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8d5fc780-6fe6-45e6-aecd-543a1f772a17 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:35.594297 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8d5fc780-6fe6-45e6-aecd-543a1f772a17 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:35.656558 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8d5fc780-6fe6-45e6-aecd-543a1f772a17 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:35.664204 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8d5fc780-6fe6-45e6-aecd-543a1f772a17 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081686 Jul 19 09:42:35.665030 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 783/1593] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:35 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:36.013119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-31917ca2-a57e-4eb1-bc17-6a66cade2534 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:36.013729 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-31917ca2-a57e-4eb1-bc17-6a66cade2534 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:36.020220 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-31917ca2-a57e-4eb1-bc17-6a66cade2534 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:36.020682 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-31917ca2-a57e-4eb1-bc17-6a66cade2534 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:36.021467 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-31917ca2-a57e-4eb1-bc17-6a66cade2534 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:36.021900 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-31917ca2-a57e-4eb1-bc17-6a66cade2534 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:36.084466 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-31917ca2-a57e-4eb1-bc17-6a66cade2534 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:36.092977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-31917ca2-a57e-4eb1-bc17-6a66cade2534 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.083453 Jul 19 09:42:36.093871 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 811/1594] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:36 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:36.680908 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c3ac35c3-93b6-496a-8b7e-0d6c00ef377a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:36.681506 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c3ac35c3-93b6-496a-8b7e-0d6c00ef377a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:36.687555 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3ac35c3-93b6-496a-8b7e-0d6c00ef377a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:36.688006 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3ac35c3-93b6-496a-8b7e-0d6c00ef377a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:36.688772 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3ac35c3-93b6-496a-8b7e-0d6c00ef377a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:36.689205 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c3ac35c3-93b6-496a-8b7e-0d6c00ef377a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:36.748281 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c3ac35c3-93b6-496a-8b7e-0d6c00ef377a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:36.755805 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c3ac35c3-93b6-496a-8b7e-0d6c00ef377a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078533 Jul 19 09:42:36.756369 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 784/1595] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:36 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:37.110061 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-769fafb4-e3c6-4d16-b453-5de577a4ae19 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:37.110604 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-769fafb4-e3c6-4d16-b453-5de577a4ae19 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:37.116339 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-769fafb4-e3c6-4d16-b453-5de577a4ae19 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:37.116788 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-769fafb4-e3c6-4d16-b453-5de577a4ae19 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:37.117548 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-769fafb4-e3c6-4d16-b453-5de577a4ae19 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:37.117983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-769fafb4-e3c6-4d16-b453-5de577a4ae19 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:37.178596 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-769fafb4-e3c6-4d16-b453-5de577a4ae19 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:37.186346 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-769fafb4-e3c6-4d16-b453-5de577a4ae19 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079955 Jul 19 09:42:37.186913 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 812/1596] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:37 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:37.772049 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1ec90b73-b8ca-41c1-8890-47c1af42e1fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:37.772685 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1ec90b73-b8ca-41c1-8890-47c1af42e1fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:37.778427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1ec90b73-b8ca-41c1-8890-47c1af42e1fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:37.778873 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1ec90b73-b8ca-41c1-8890-47c1af42e1fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:37.779661 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1ec90b73-b8ca-41c1-8890-47c1af42e1fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:37.780094 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1ec90b73-b8ca-41c1-8890-47c1af42e1fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:37.839256 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1ec90b73-b8ca-41c1-8890-47c1af42e1fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:37.847243 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1ec90b73-b8ca-41c1-8890-47c1af42e1fb tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078279 Jul 19 09:42:37.847795 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 785/1597] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:37 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:38.203247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f62ff8a5-24f9-4c5c-add2-ca0406788805 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:38.203857 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f62ff8a5-24f9-4c5c-add2-ca0406788805 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:38.210079 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f62ff8a5-24f9-4c5c-add2-ca0406788805 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:38.210522 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f62ff8a5-24f9-4c5c-add2-ca0406788805 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:38.211310 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f62ff8a5-24f9-4c5c-add2-ca0406788805 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:38.211748 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f62ff8a5-24f9-4c5c-add2-ca0406788805 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:38.270359 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f62ff8a5-24f9-4c5c-add2-ca0406788805 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:38.277818 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f62ff8a5-24f9-4c5c-add2-ca0406788805 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078356 Jul 19 09:42:38.278376 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 813/1598] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:38 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:38.864087 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bd99e6df-a100-4469-bc9a-5dabda6072f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:38.864640 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bd99e6df-a100-4469-bc9a-5dabda6072f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:38.870596 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd99e6df-a100-4469-bc9a-5dabda6072f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:38.871062 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd99e6df-a100-4469-bc9a-5dabda6072f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:38.871916 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd99e6df-a100-4469-bc9a-5dabda6072f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:38.872352 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bd99e6df-a100-4469-bc9a-5dabda6072f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:38.932221 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bd99e6df-a100-4469-bc9a-5dabda6072f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:38.939771 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bd99e6df-a100-4469-bc9a-5dabda6072f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079865 Jul 19 09:42:38.940923 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 786/1599] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:38 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:39.294364 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d328cab9-0ace-4136-ae6d-82a0edf51f32 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:39.294972 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d328cab9-0ace-4136-ae6d-82a0edf51f32 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:39.301389 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d328cab9-0ace-4136-ae6d-82a0edf51f32 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:39.301836 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d328cab9-0ace-4136-ae6d-82a0edf51f32 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:39.302590 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d328cab9-0ace-4136-ae6d-82a0edf51f32 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:39.303021 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d328cab9-0ace-4136-ae6d-82a0edf51f32 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:39.364886 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d328cab9-0ace-4136-ae6d-82a0edf51f32 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:39.372457 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d328cab9-0ace-4136-ae6d-82a0edf51f32 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.081799 Jul 19 09:42:39.373018 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 814/1600] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:39 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:39.957280 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7cf893a2-25a2-4aff-b9ce-8b52afe5edc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:39.957883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7cf893a2-25a2-4aff-b9ce-8b52afe5edc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:39.963655 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7cf893a2-25a2-4aff-b9ce-8b52afe5edc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:39.964102 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7cf893a2-25a2-4aff-b9ce-8b52afe5edc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:39.964864 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7cf893a2-25a2-4aff-b9ce-8b52afe5edc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:39.965295 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7cf893a2-25a2-4aff-b9ce-8b52afe5edc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:40.028121 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7cf893a2-25a2-4aff-b9ce-8b52afe5edc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:40.035675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7cf893a2-25a2-4aff-b9ce-8b52afe5edc8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.082612 Jul 19 09:42:40.036237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 787/1601] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:39 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:40.388958 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9f7dfd6c-14ed-44cb-a08d-11453b34f092 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:40.389532 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9f7dfd6c-14ed-44cb-a08d-11453b34f092 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:40.395273 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f7dfd6c-14ed-44cb-a08d-11453b34f092 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:40.395717 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f7dfd6c-14ed-44cb-a08d-11453b34f092 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:40.396474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f7dfd6c-14ed-44cb-a08d-11453b34f092 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:40.396905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f7dfd6c-14ed-44cb-a08d-11453b34f092 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:40.456312 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9f7dfd6c-14ed-44cb-a08d-11453b34f092 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:40.463923 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9f7dfd6c-14ed-44cb-a08d-11453b34f092 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078739 Jul 19 09:42:40.464482 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 815/1602] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:40 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:41.052415 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-69c032a4-d863-4296-b176-1a8987a5c812 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:41.053068 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-69c032a4-d863-4296-b176-1a8987a5c812 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:41.058709 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-69c032a4-d863-4296-b176-1a8987a5c812 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:41.059194 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-69c032a4-d863-4296-b176-1a8987a5c812 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:41.059951 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-69c032a4-d863-4296-b176-1a8987a5c812 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:41.060380 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-69c032a4-d863-4296-b176-1a8987a5c812 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:41.119195 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-69c032a4-d863-4296-b176-1a8987a5c812 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:41.126876 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-69c032a4-d863-4296-b176-1a8987a5c812 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.077979 Jul 19 09:42:41.127502 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 788/1603] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:41 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:41.480145 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b9939d18-3478-4704-a19c-b9f7193b65a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:41.480756 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b9939d18-3478-4704-a19c-b9f7193b65a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:41.486523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9939d18-3478-4704-a19c-b9f7193b65a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:41.486971 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9939d18-3478-4704-a19c-b9f7193b65a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:41.487783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9939d18-3478-4704-a19c-b9f7193b65a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:41.488217 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9939d18-3478-4704-a19c-b9f7193b65a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:41.547255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b9939d18-3478-4704-a19c-b9f7193b65a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:41.554653 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b9939d18-3478-4704-a19c-b9f7193b65a0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078164 Jul 19 09:42:41.555233 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 816/1604] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:41 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:42.143323 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f15c6839-3283-4f1b-a5f6-dfe5c37c149c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:42.143931 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f15c6839-3283-4f1b-a5f6-dfe5c37c149c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:42.149647 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f15c6839-3283-4f1b-a5f6-dfe5c37c149c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:42.150095 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f15c6839-3283-4f1b-a5f6-dfe5c37c149c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:42.150849 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f15c6839-3283-4f1b-a5f6-dfe5c37c149c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:42.151308 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f15c6839-3283-4f1b-a5f6-dfe5c37c149c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:42.211362 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f15c6839-3283-4f1b-a5f6-dfe5c37c149c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:42.218887 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f15c6839-3283-4f1b-a5f6-dfe5c37c149c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079273 Jul 19 09:42:42.219480 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 789/1605] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:42 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:42.571290 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1e8d5a22-6e09-4deb-98a5-2c8fe5a514c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:42.571887 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1e8d5a22-6e09-4deb-98a5-2c8fe5a514c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:42.577748 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e8d5a22-6e09-4deb-98a5-2c8fe5a514c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:42.578190 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e8d5a22-6e09-4deb-98a5-2c8fe5a514c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:42.578941 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e8d5a22-6e09-4deb-98a5-2c8fe5a514c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:42.579388 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e8d5a22-6e09-4deb-98a5-2c8fe5a514c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:42.638221 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1e8d5a22-6e09-4deb-98a5-2c8fe5a514c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:42.646193 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1e8d5a22-6e09-4deb-98a5-2c8fe5a514c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078649 Jul 19 09:42:42.646752 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 817/1606] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:42 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:43.236119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-048dfb75-78e0-4188-bb83-2d2d979ad2e2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:43.237224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-048dfb75-78e0-4188-bb83-2d2d979ad2e2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:43.242907 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-048dfb75-78e0-4188-bb83-2d2d979ad2e2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:43.243367 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-048dfb75-78e0-4188-bb83-2d2d979ad2e2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:43.244119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-048dfb75-78e0-4188-bb83-2d2d979ad2e2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:43.244611 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-048dfb75-78e0-4188-bb83-2d2d979ad2e2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:43.308705 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-048dfb75-78e0-4188-bb83-2d2d979ad2e2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:43.316863 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-048dfb75-78e0-4188-bb83-2d2d979ad2e2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.084569 Jul 19 09:42:43.317450 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 790/1607] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:43 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:43.661936 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-91be9e65-f99c-4abb-9217-91b3935bb702 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:43.662545 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-91be9e65-f99c-4abb-9217-91b3935bb702 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:43.668446 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-91be9e65-f99c-4abb-9217-91b3935bb702 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:43.668888 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-91be9e65-f99c-4abb-9217-91b3935bb702 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:43.669656 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-91be9e65-f99c-4abb-9217-91b3935bb702 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:43.670082 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-91be9e65-f99c-4abb-9217-91b3935bb702 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:43.731924 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-91be9e65-f99c-4abb-9217-91b3935bb702 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:43.740053 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-91be9e65-f99c-4abb-9217-91b3935bb702 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.082363 Jul 19 09:42:43.740609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 818/1608] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:43 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:44.333381 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f01fd265-1931-4c5d-9d04-c99baf27e975 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:44.334012 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f01fd265-1931-4c5d-9d04-c99baf27e975 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:44.339640 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f01fd265-1931-4c5d-9d04-c99baf27e975 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:44.340081 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f01fd265-1931-4c5d-9d04-c99baf27e975 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:44.340827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f01fd265-1931-4c5d-9d04-c99baf27e975 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:44.341253 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f01fd265-1931-4c5d-9d04-c99baf27e975 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:44.400331 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f01fd265-1931-4c5d-9d04-c99baf27e975 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:44.407707 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f01fd265-1931-4c5d-9d04-c99baf27e975 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078020 Jul 19 09:42:44.408252 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 791/1609] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:44 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:44.755206 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cc0fd764-2202-40c8-9646-b02fd1561aaf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:44.755746 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-cc0fd764-2202-40c8-9646-b02fd1561aaf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:44.761560 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc0fd764-2202-40c8-9646-b02fd1561aaf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:44.762009 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc0fd764-2202-40c8-9646-b02fd1561aaf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:44.762763 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc0fd764-2202-40c8-9646-b02fd1561aaf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:44.763226 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc0fd764-2202-40c8-9646-b02fd1561aaf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:44.821686 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cc0fd764-2202-40c8-9646-b02fd1561aaf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:44.829180 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-cc0fd764-2202-40c8-9646-b02fd1561aaf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.077748 Jul 19 09:42:44.829737 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 819/1610] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:44 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:45.424858 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-eca964a6-5449-4573-93a8-bdcbd2fcd63b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:45.425438 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-eca964a6-5449-4573-93a8-bdcbd2fcd63b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:45.431314 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eca964a6-5449-4573-93a8-bdcbd2fcd63b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:45.431783 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eca964a6-5449-4573-93a8-bdcbd2fcd63b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:45.432531 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eca964a6-5449-4573-93a8-bdcbd2fcd63b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:45.432959 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eca964a6-5449-4573-93a8-bdcbd2fcd63b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:45.492692 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-eca964a6-5449-4573-93a8-bdcbd2fcd63b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:45.500092 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-eca964a6-5449-4573-93a8-bdcbd2fcd63b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078933 Jul 19 09:42:45.500646 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 792/1611] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:45 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:45.845597 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-28afd02d-7a74-4b1c-8ad0-52addd93e6f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:45.846743 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-28afd02d-7a74-4b1c-8ad0-52addd93e6f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:45.852537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-28afd02d-7a74-4b1c-8ad0-52addd93e6f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:45.852984 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-28afd02d-7a74-4b1c-8ad0-52addd93e6f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:45.853742 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-28afd02d-7a74-4b1c-8ad0-52addd93e6f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:45.854173 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-28afd02d-7a74-4b1c-8ad0-52addd93e6f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:45.912943 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-28afd02d-7a74-4b1c-8ad0-52addd93e6f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:45.920673 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-28afd02d-7a74-4b1c-8ad0-52addd93e6f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078748 Jul 19 09:42:45.921252 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 820/1612] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:45 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:46.516440 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1677bd56-8ebf-415b-8221-b4f3d6ac9a10 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:46.517049 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1677bd56-8ebf-415b-8221-b4f3d6ac9a10 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:46.522905 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1677bd56-8ebf-415b-8221-b4f3d6ac9a10 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:46.523392 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1677bd56-8ebf-415b-8221-b4f3d6ac9a10 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:46.524160 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1677bd56-8ebf-415b-8221-b4f3d6ac9a10 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:46.524594 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1677bd56-8ebf-415b-8221-b4f3d6ac9a10 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:46.585235 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1677bd56-8ebf-415b-8221-b4f3d6ac9a10 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:46.592777 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1677bd56-8ebf-415b-8221-b4f3d6ac9a10 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.080029 Jul 19 09:42:46.593330 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 793/1613] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:46 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:46.936656 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-183844d8-a3b1-4cf0-97eb-c94c181c1bf6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:46.937255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-183844d8-a3b1-4cf0-97eb-c94c181c1bf6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:46.943024 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-183844d8-a3b1-4cf0-97eb-c94c181c1bf6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:46.943491 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-183844d8-a3b1-4cf0-97eb-c94c181c1bf6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:46.944238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-183844d8-a3b1-4cf0-97eb-c94c181c1bf6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:46.944664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-183844d8-a3b1-4cf0-97eb-c94c181c1bf6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:47.003471 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-183844d8-a3b1-4cf0-97eb-c94c181c1bf6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:47.010873 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-183844d8-a3b1-4cf0-97eb-c94c181c1bf6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.077869 Jul 19 09:42:47.011458 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 821/1614] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:46 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:42:47.609755 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6c1244ed-4932-4c72-aff0-04719e02a36a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:47.610357 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6c1244ed-4932-4c72-aff0-04719e02a36a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:47.616190 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6c1244ed-4932-4c72-aff0-04719e02a36a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:47.616636 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6c1244ed-4932-4c72-aff0-04719e02a36a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:47.617384 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6c1244ed-4932-4c72-aff0-04719e02a36a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:47.617811 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6c1244ed-4932-4c72-aff0-04719e02a36a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:47.680437 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6c1244ed-4932-4c72-aff0-04719e02a36a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:47.687920 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6c1244ed-4932-4c72-aff0-04719e02a36a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081944 Jul 19 09:42:47.688470 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 794/1615] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:47 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:48.027664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-086ad257-edad-490e-a793-7206d63eb039 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:48.028270 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-086ad257-edad-490e-a793-7206d63eb039 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:48.033986 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-086ad257-edad-490e-a793-7206d63eb039 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:48.034423 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-086ad257-edad-490e-a793-7206d63eb039 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:48.035202 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-086ad257-edad-490e-a793-7206d63eb039 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:48.035631 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-086ad257-edad-490e-a793-7206d63eb039 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:48.098228 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-086ad257-edad-490e-a793-7206d63eb039 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:48.105718 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-086ad257-edad-490e-a793-7206d63eb039 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.081825 Jul 19 09:42:48.106271 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 822/1616] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:48 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:48.706021 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-338fe6a7-3aca-41f6-92fc-88a1f79d28ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:48.706530 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-338fe6a7-3aca-41f6-92fc-88a1f79d28ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:48.712827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-338fe6a7-3aca-41f6-92fc-88a1f79d28ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:48.713307 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-338fe6a7-3aca-41f6-92fc-88a1f79d28ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:48.714104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-338fe6a7-3aca-41f6-92fc-88a1f79d28ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:48.714559 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-338fe6a7-3aca-41f6-92fc-88a1f79d28ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:48.773441 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-338fe6a7-3aca-41f6-92fc-88a1f79d28ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:48.780995 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-338fe6a7-3aca-41f6-92fc-88a1f79d28ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079245 Jul 19 09:42:48.781557 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 795/1617] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:48 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:49.121941 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-30297890-ab01-4d2e-b30b-4613178a9213 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:49.122488 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-30297890-ab01-4d2e-b30b-4613178a9213 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:49.128650 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-30297890-ab01-4d2e-b30b-4613178a9213 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:49.129096 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-30297890-ab01-4d2e-b30b-4613178a9213 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:49.129879 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-30297890-ab01-4d2e-b30b-4613178a9213 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:49.130308 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-30297890-ab01-4d2e-b30b-4613178a9213 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:49.189513 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-30297890-ab01-4d2e-b30b-4613178a9213 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:49.197624 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-30297890-ab01-4d2e-b30b-4613178a9213 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079388 Jul 19 09:42:49.198179 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 823/1618] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:49 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:49.798490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cc1d539a-a057-4371-afd6-f5a5f087ade2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:49.799157 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cc1d539a-a057-4371-afd6-f5a5f087ade2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:49.805317 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc1d539a-a057-4371-afd6-f5a5f087ade2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:49.805759 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc1d539a-a057-4371-afd6-f5a5f087ade2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:49.806518 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc1d539a-a057-4371-afd6-f5a5f087ade2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:49.806947 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc1d539a-a057-4371-afd6-f5a5f087ade2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:49.866080 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cc1d539a-a057-4371-afd6-f5a5f087ade2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:49.873618 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cc1d539a-a057-4371-afd6-f5a5f087ade2 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078841 Jul 19 09:42:49.874178 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 796/1619] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:49 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:50.214560 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-37f64c37-fd5b-4fb5-9c9e-78a08123a9ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:50.215202 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-37f64c37-fd5b-4fb5-9c9e-78a08123a9ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:50.221666 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37f64c37-fd5b-4fb5-9c9e-78a08123a9ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:50.222115 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37f64c37-fd5b-4fb5-9c9e-78a08123a9ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:50.222876 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37f64c37-fd5b-4fb5-9c9e-78a08123a9ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:50.223334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-37f64c37-fd5b-4fb5-9c9e-78a08123a9ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:50.281762 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-37f64c37-fd5b-4fb5-9c9e-78a08123a9ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:50.290003 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-37f64c37-fd5b-4fb5-9c9e-78a08123a9ed tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078785 Jul 19 09:42:50.290543 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 824/1620] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:50 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:50.889868 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-53e353c3-344b-46de-9af9-54ed26e28ea0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:50.890404 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-53e353c3-344b-46de-9af9-54ed26e28ea0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:50.896210 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-53e353c3-344b-46de-9af9-54ed26e28ea0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:50.896652 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-53e353c3-344b-46de-9af9-54ed26e28ea0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:50.897393 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-53e353c3-344b-46de-9af9-54ed26e28ea0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:50.897818 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-53e353c3-344b-46de-9af9-54ed26e28ea0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:50.956840 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-53e353c3-344b-46de-9af9-54ed26e28ea0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:50.964237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-53e353c3-344b-46de-9af9-54ed26e28ea0 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078076 Jul 19 09:42:50.964790 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 797/1621] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:50 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:51.306196 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-32e6d160-b3eb-45ae-9f3b-e702aedfc803 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:51.306807 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-32e6d160-b3eb-45ae-9f3b-e702aedfc803 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:51.312599 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-32e6d160-b3eb-45ae-9f3b-e702aedfc803 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:51.313055 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-32e6d160-b3eb-45ae-9f3b-e702aedfc803 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:51.313818 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-32e6d160-b3eb-45ae-9f3b-e702aedfc803 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:51.314256 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-32e6d160-b3eb-45ae-9f3b-e702aedfc803 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:51.373358 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-32e6d160-b3eb-45ae-9f3b-e702aedfc803 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:51.381243 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-32e6d160-b3eb-45ae-9f3b-e702aedfc803 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078724 Jul 19 09:42:51.381803 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 825/1622] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:51 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:51.980794 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-77625587-1395-4287-a5bf-4249acbe0537 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:51.981431 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-77625587-1395-4287-a5bf-4249acbe0537 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:51.987156 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-77625587-1395-4287-a5bf-4249acbe0537 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:51.987605 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-77625587-1395-4287-a5bf-4249acbe0537 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:51.988369 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-77625587-1395-4287-a5bf-4249acbe0537 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:51.988803 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-77625587-1395-4287-a5bf-4249acbe0537 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:52.051382 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-77625587-1395-4287-a5bf-4249acbe0537 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:52.058903 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-77625587-1395-4287-a5bf-4249acbe0537 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081768 Jul 19 09:42:52.059488 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 798/1623] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:51 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:52.397424 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4c0b469b-8cce-4049-ab96-d7e98d2337e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:52.397969 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4c0b469b-8cce-4049-ab96-d7e98d2337e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:52.403828 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4c0b469b-8cce-4049-ab96-d7e98d2337e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:52.404308 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4c0b469b-8cce-4049-ab96-d7e98d2337e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:52.405062 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4c0b469b-8cce-4049-ab96-d7e98d2337e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:52.405496 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4c0b469b-8cce-4049-ab96-d7e98d2337e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:52.468060 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4c0b469b-8cce-4049-ab96-d7e98d2337e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:52.476018 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4c0b469b-8cce-4049-ab96-d7e98d2337e3 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.082275 Jul 19 09:42:52.476584 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 826/1624] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:52 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:53.075018 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-eefab777-5269-416c-9b30-ba62bc559b4c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:53.075642 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-eefab777-5269-416c-9b30-ba62bc559b4c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:53.081450 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eefab777-5269-416c-9b30-ba62bc559b4c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:53.081892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eefab777-5269-416c-9b30-ba62bc559b4c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:53.082649 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eefab777-5269-416c-9b30-ba62bc559b4c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:53.083101 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eefab777-5269-416c-9b30-ba62bc559b4c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:53.142248 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-eefab777-5269-416c-9b30-ba62bc559b4c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:53.149885 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-eefab777-5269-416c-9b30-ba62bc559b4c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078533 Jul 19 09:42:53.150436 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 799/1625] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:53 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:53.492727 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9f8ad862-f6a1-487d-a814-75a9b66e4b28 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:53.493364 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9f8ad862-f6a1-487d-a814-75a9b66e4b28 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:53.499169 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f8ad862-f6a1-487d-a814-75a9b66e4b28 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:53.499622 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f8ad862-f6a1-487d-a814-75a9b66e4b28 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:53.500377 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f8ad862-f6a1-487d-a814-75a9b66e4b28 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:53.500809 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f8ad862-f6a1-487d-a814-75a9b66e4b28 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:53.560021 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9f8ad862-f6a1-487d-a814-75a9b66e4b28 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:53.567591 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9f8ad862-f6a1-487d-a814-75a9b66e4b28 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078507 Jul 19 09:42:53.568155 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 827/1626] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:53 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:54.165729 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-647e0b92-f65e-414a-927a-07c33f9140ae tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:54.166339 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-647e0b92-f65e-414a-927a-07c33f9140ae tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:54.172403 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-647e0b92-f65e-414a-927a-07c33f9140ae tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:54.172846 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-647e0b92-f65e-414a-927a-07c33f9140ae tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:54.173596 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-647e0b92-f65e-414a-927a-07c33f9140ae tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:54.174024 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-647e0b92-f65e-414a-927a-07c33f9140ae tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:54.233922 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-647e0b92-f65e-414a-927a-07c33f9140ae tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:54.241554 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-647e0b92-f65e-414a-927a-07c33f9140ae tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079750 Jul 19 09:42:54.242110 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 800/1627] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:54 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:54.583624 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e2970dc9-8457-4522-ba34-606a9fabce9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:54.584276 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e2970dc9-8457-4522-ba34-606a9fabce9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:54.590310 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e2970dc9-8457-4522-ba34-606a9fabce9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:54.590753 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e2970dc9-8457-4522-ba34-606a9fabce9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:54.591538 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e2970dc9-8457-4522-ba34-606a9fabce9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:54.591973 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e2970dc9-8457-4522-ba34-606a9fabce9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:54.652262 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e2970dc9-8457-4522-ba34-606a9fabce9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:54.659779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e2970dc9-8457-4522-ba34-606a9fabce9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079761 Jul 19 09:42:54.660342 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 828/1628] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:54 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:55.257826 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-186c2334-c78a-43ec-aadb-7396715ce3fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:55.258433 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-186c2334-c78a-43ec-aadb-7396715ce3fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:55.264237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-186c2334-c78a-43ec-aadb-7396715ce3fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:55.264717 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-186c2334-c78a-43ec-aadb-7396715ce3fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:55.265471 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-186c2334-c78a-43ec-aadb-7396715ce3fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:55.265905 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-186c2334-c78a-43ec-aadb-7396715ce3fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:55.324715 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-186c2334-c78a-43ec-aadb-7396715ce3fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:55.332905 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-186c2334-c78a-43ec-aadb-7396715ce3fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078761 Jul 19 09:42:55.333459 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 801/1629] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:55 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:55.676934 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e8198824-2a8d-4611-babc-888f65817dc9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:55.677543 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e8198824-2a8d-4611-babc-888f65817dc9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:55.683750 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e8198824-2a8d-4611-babc-888f65817dc9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:55.684213 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e8198824-2a8d-4611-babc-888f65817dc9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:55.684969 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e8198824-2a8d-4611-babc-888f65817dc9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:55.685412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e8198824-2a8d-4611-babc-888f65817dc9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:55.888735 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e8198824-2a8d-4611-babc-888f65817dc9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:55.896639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e8198824-2a8d-4611-babc-888f65817dc9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.223372 Jul 19 09:42:55.897199 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 829/1630] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:55 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:56.349621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9d90e0ce-14a7-4006-851f-4f4da3667143 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:56.350161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9d90e0ce-14a7-4006-851f-4f4da3667143 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:56.355892 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d90e0ce-14a7-4006-851f-4f4da3667143 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:56.356328 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d90e0ce-14a7-4006-851f-4f4da3667143 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:56.357073 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d90e0ce-14a7-4006-851f-4f4da3667143 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:56.357498 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d90e0ce-14a7-4006-851f-4f4da3667143 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:56.419259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9d90e0ce-14a7-4006-851f-4f4da3667143 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:56.427305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9d90e0ce-14a7-4006-851f-4f4da3667143 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.081879 Jul 19 09:42:56.427856 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 802/1631] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:56 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:56.913299 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-72c5fb35-9e8e-4ff5-b7c1-f9dadac44d31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:56.913900 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-72c5fb35-9e8e-4ff5-b7c1-f9dadac44d31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:56.919962 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-72c5fb35-9e8e-4ff5-b7c1-f9dadac44d31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:56.920408 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-72c5fb35-9e8e-4ff5-b7c1-f9dadac44d31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:56.921157 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-72c5fb35-9e8e-4ff5-b7c1-f9dadac44d31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:56.921586 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-72c5fb35-9e8e-4ff5-b7c1-f9dadac44d31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:56.983100 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-72c5fb35-9e8e-4ff5-b7c1-f9dadac44d31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:56.990686 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-72c5fb35-9e8e-4ff5-b7c1-f9dadac44d31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.081589 Jul 19 09:42:56.991261 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 830/1632] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:56 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:57.444195 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ed1eec99-51c7-460e-8ecc-dda106b1de45 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:57.444740 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ed1eec99-51c7-460e-8ecc-dda106b1de45 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:57.450520 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ed1eec99-51c7-460e-8ecc-dda106b1de45 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:57.450968 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ed1eec99-51c7-460e-8ecc-dda106b1de45 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:57.451762 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ed1eec99-51c7-460e-8ecc-dda106b1de45 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:57.452199 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ed1eec99-51c7-460e-8ecc-dda106b1de45 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:57.511975 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ed1eec99-51c7-460e-8ecc-dda106b1de45 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:57.519550 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ed1eec99-51c7-460e-8ecc-dda106b1de45 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079642 Jul 19 09:42:57.520104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 803/1633] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:57 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:58.006804 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-69bf06bb-17f2-4c3f-9f6b-d40e27e9532c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:58.007511 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-69bf06bb-17f2-4c3f-9f6b-d40e27e9532c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:58.013280 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69bf06bb-17f2-4c3f-9f6b-d40e27e9532c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:58.013727 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69bf06bb-17f2-4c3f-9f6b-d40e27e9532c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:58.014481 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69bf06bb-17f2-4c3f-9f6b-d40e27e9532c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:58.014922 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69bf06bb-17f2-4c3f-9f6b-d40e27e9532c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:58.074334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-69bf06bb-17f2-4c3f-9f6b-d40e27e9532c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:58.081964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-69bf06bb-17f2-4c3f-9f6b-d40e27e9532c tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078804 Jul 19 09:42:58.082510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 831/1634] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:58 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:42:58.536605 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6dd8aa1d-908d-4780-ae14-cc89dd6819cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:58.537210 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6dd8aa1d-908d-4780-ae14-cc89dd6819cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:58.543259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6dd8aa1d-908d-4780-ae14-cc89dd6819cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:58.543702 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6dd8aa1d-908d-4780-ae14-cc89dd6819cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:58.544462 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6dd8aa1d-908d-4780-ae14-cc89dd6819cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:58.544891 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6dd8aa1d-908d-4780-ae14-cc89dd6819cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:58.604096 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6dd8aa1d-908d-4780-ae14-cc89dd6819cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:58.611692 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6dd8aa1d-908d-4780-ae14-cc89dd6819cd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079401 Jul 19 09:42:58.612255 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 804/1635] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:58 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:59.098180 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-21c50539-76e0-4085-bb34-e8d87a7b73c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:59.098791 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-21c50539-76e0-4085-bb34-e8d87a7b73c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:59.104540 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-21c50539-76e0-4085-bb34-e8d87a7b73c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:59.104995 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-21c50539-76e0-4085-bb34-e8d87a7b73c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:59.105786 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-21c50539-76e0-4085-bb34-e8d87a7b73c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:59.106224 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-21c50539-76e0-4085-bb34-e8d87a7b73c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:59.165950 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-21c50539-76e0-4085-bb34-e8d87a7b73c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:59.173632 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-21c50539-76e0-4085-bb34-e8d87a7b73c9 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079120 Jul 19 09:42:59.174187 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 832/1636] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:59 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:42:59.628008 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6ee2bdc9-fb58-410f-8aca-56c7d2f22b66 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:42:59.628640 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6ee2bdc9-fb58-410f-8aca-56c7d2f22b66 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:42:59.634299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ee2bdc9-fb58-410f-8aca-56c7d2f22b66 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:59.634745 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ee2bdc9-fb58-410f-8aca-56c7d2f22b66 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:59.635543 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ee2bdc9-fb58-410f-8aca-56c7d2f22b66 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:42:59.636005 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ee2bdc9-fb58-410f-8aca-56c7d2f22b66 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:42:59.695144 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6ee2bdc9-fb58-410f-8aca-56c7d2f22b66 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:42:59.702569 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6ee2bdc9-fb58-410f-8aca-56c7d2f22b66 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078250 Jul 19 09:42:59.703143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 805/1637] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:42:59 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:00.190439 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-dfffe501-539b-4e99-88a4-1dac9c6ed4b1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:00.191615 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-dfffe501-539b-4e99-88a4-1dac9c6ed4b1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:00.197392 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dfffe501-539b-4e99-88a4-1dac9c6ed4b1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:00.197848 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dfffe501-539b-4e99-88a4-1dac9c6ed4b1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:00.198611 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dfffe501-539b-4e99-88a4-1dac9c6ed4b1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:00.199060 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-dfffe501-539b-4e99-88a4-1dac9c6ed4b1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:00.257877 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-dfffe501-539b-4e99-88a4-1dac9c6ed4b1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:00.265352 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-dfffe501-539b-4e99-88a4-1dac9c6ed4b1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078579 Jul 19 09:43:00.265905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 833/1638] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:00 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:00.719515 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-312b65d3-2b1e-492f-a085-1c482caf0d8a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:00.720143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-312b65d3-2b1e-492f-a085-1c482caf0d8a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:00.725893 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-312b65d3-2b1e-492f-a085-1c482caf0d8a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:00.726337 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-312b65d3-2b1e-492f-a085-1c482caf0d8a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:00.727108 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-312b65d3-2b1e-492f-a085-1c482caf0d8a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:00.727537 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-312b65d3-2b1e-492f-a085-1c482caf0d8a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:01.042112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-312b65d3-2b1e-492f-a085-1c482caf0d8a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:01.049881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-312b65d3-2b1e-492f-a085-1c482caf0d8a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.334128 Jul 19 09:43:01.051025 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 806/1639] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:00 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:01.282051 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-52bdb1f3-66e0-4296-ab0a-cefebefc588b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:01.282656 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-52bdb1f3-66e0-4296-ab0a-cefebefc588b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:01.289016 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-52bdb1f3-66e0-4296-ab0a-cefebefc588b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:01.289515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-52bdb1f3-66e0-4296-ab0a-cefebefc588b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:01.290473 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-52bdb1f3-66e0-4296-ab0a-cefebefc588b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:01.290899 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-52bdb1f3-66e0-4296-ab0a-cefebefc588b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:01.352988 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-52bdb1f3-66e0-4296-ab0a-cefebefc588b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:01.360565 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-52bdb1f3-66e0-4296-ab0a-cefebefc588b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.082162 Jul 19 09:43:01.361113 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 834/1640] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:01 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:02.066940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ce178713-2550-4299-9295-ae852ac84b50 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:02.067595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ce178713-2550-4299-9295-ae852ac84b50 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:02.073327 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ce178713-2550-4299-9295-ae852ac84b50 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:02.073782 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ce178713-2550-4299-9295-ae852ac84b50 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:02.074552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ce178713-2550-4299-9295-ae852ac84b50 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:02.074988 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ce178713-2550-4299-9295-ae852ac84b50 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:02.133876 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ce178713-2550-4299-9295-ae852ac84b50 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:02.141581 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ce178713-2550-4299-9295-ae852ac84b50 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078309 Jul 19 09:43:02.142137 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 807/1641] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:02 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:02.377067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ecf28441-d80c-4cce-9c7e-bde43d30738f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:02.377604 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ecf28441-d80c-4cce-9c7e-bde43d30738f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:02.383946 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ecf28441-d80c-4cce-9c7e-bde43d30738f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:02.384399 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ecf28441-d80c-4cce-9c7e-bde43d30738f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:02.385151 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ecf28441-d80c-4cce-9c7e-bde43d30738f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:02.385582 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ecf28441-d80c-4cce-9c7e-bde43d30738f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:02.445230 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ecf28441-d80c-4cce-9c7e-bde43d30738f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:02.452655 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ecf28441-d80c-4cce-9c7e-bde43d30738f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079324 Jul 19 09:43:02.453216 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 835/1642] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:02 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:03.158727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-32e19118-e410-443f-9020-0468377b508c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:03.159837 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-32e19118-e410-443f-9020-0468377b508c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:03.165891 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32e19118-e410-443f-9020-0468377b508c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:03.166335 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32e19118-e410-443f-9020-0468377b508c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:03.167116 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32e19118-e410-443f-9020-0468377b508c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:03.167548 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32e19118-e410-443f-9020-0468377b508c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:03.226807 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-32e19118-e410-443f-9020-0468377b508c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:03.234237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-32e19118-e410-443f-9020-0468377b508c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.079383 Jul 19 09:43:03.234787 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 808/1643] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:03 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:03.469443 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6b7cc0b7-ccf2-4e45-9ff2-79ed62623174 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:03.470049 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6b7cc0b7-ccf2-4e45-9ff2-79ed62623174 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:03.476468 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6b7cc0b7-ccf2-4e45-9ff2-79ed62623174 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:03.476916 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6b7cc0b7-ccf2-4e45-9ff2-79ed62623174 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:03.477672 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6b7cc0b7-ccf2-4e45-9ff2-79ed62623174 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:03.478099 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6b7cc0b7-ccf2-4e45-9ff2-79ed62623174 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:03.537537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6b7cc0b7-ccf2-4e45-9ff2-79ed62623174 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:03.545575 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6b7cc0b7-ccf2-4e45-9ff2-79ed62623174 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079791 Jul 19 09:43:03.546126 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 836/1644] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:03 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:04.250732 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a41a6cf0-e534-4be7-bf99-6d23addf5169 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:04.251374 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a41a6cf0-e534-4be7-bf99-6d23addf5169 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:04.257022 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a41a6cf0-e534-4be7-bf99-6d23addf5169 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:04.257468 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a41a6cf0-e534-4be7-bf99-6d23addf5169 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:04.258224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a41a6cf0-e534-4be7-bf99-6d23addf5169 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:04.258658 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a41a6cf0-e534-4be7-bf99-6d23addf5169 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:04.317961 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a41a6cf0-e534-4be7-bf99-6d23addf5169 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:04.325573 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a41a6cf0-e534-4be7-bf99-6d23addf5169 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 200 len: 1367 microversion: 2.1 time: 0.078575 Jul 19 09:43:04.326125 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 809/1645] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:04 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:04.562338 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9f0324fb-c130-4e66-9725-a94e12eba679 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:04.562937 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9f0324fb-c130-4e66-9725-a94e12eba679 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:04.569404 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f0324fb-c130-4e66-9725-a94e12eba679 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:04.569846 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f0324fb-c130-4e66-9725-a94e12eba679 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:04.570848 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f0324fb-c130-4e66-9725-a94e12eba679 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:04.571311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9f0324fb-c130-4e66-9725-a94e12eba679 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:04.630290 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9f0324fb-c130-4e66-9725-a94e12eba679 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:04.637857 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9f0324fb-c130-4e66-9725-a94e12eba679 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079109 Jul 19 09:43:04.638409 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 837/1646] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:04 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:43:05.343154 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-643b809d-7a44-46be-9575-f72615247a18 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:05.343784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-643b809d-7a44-46be-9575-f72615247a18 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:05.349485 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-643b809d-7a44-46be-9575-f72615247a18 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:05.349934 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-643b809d-7a44-46be-9575-f72615247a18 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:05.350717 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-643b809d-7a44-46be-9575-f72615247a18 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:05.351165 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-643b809d-7a44-46be-9575-f72615247a18 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:05.364627 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-643b809d-7a44-46be-9575-f72615247a18 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] HTTP exception thrown: Instance 5bff3c23-e302-4420-a1fd-58fd8e80c1a1 could not be found. Jul 19 09:43:05.365209 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-643b809d-7a44-46be-9575-f72615247a18 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Returning 404 to user: Instance 5bff3c23-e302-4420-a1fd-58fd8e80c1a1 could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:43:05.366063 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-643b809d-7a44-46be-9575-f72615247a18 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 404 len: 111 microversion: 2.1 time: 0.027337 Jul 19 09:43:05.366590 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 810/1647] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:05 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:43:05.374803 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a3ab630e-0611-4bc6-887e-a4b908380fcc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '.version_select at 0x7f04b01e6b80>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:05.392517 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a3ab630e-0611-4bc6-887e-a4b908380fcc tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-650278060" status: 202 len: 0 microversion: 2.1 time: 0.021242 Jul 19 09:43:05.393070 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 838/1648] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Jul 19 09:43:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-650278060 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:43:05.654306 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bb0a943d-7b2d-44c6-a350-38d326c02f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:05.655146 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bb0a943d-7b2d-44c6-a350-38d326c02f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:05.660737 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bb0a943d-7b2d-44c6-a350-38d326c02f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:05.661184 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bb0a943d-7b2d-44c6-a350-38d326c02f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:05.661996 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bb0a943d-7b2d-44c6-a350-38d326c02f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:05.662414 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bb0a943d-7b2d-44c6-a350-38d326c02f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:05.724089 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bb0a943d-7b2d-44c6-a350-38d326c02f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:05.731606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bb0a943d-7b2d-44c6-a350-38d326c02f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.080961 Jul 19 09:43:05.732166 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 811/1649] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:05 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:06.146077 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3f130b9c-dbf4-4cd0-b72b-9eed96cf518c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'create', calling method: .version_select at 0x7f04b01e6c10>, body: {"keypair": {"name": "tempest-keypair-1988494871"}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:06.165221 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-3f130b9c-dbf4-4cd0-b72b-9eed96cf518c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Getting quotas for project 8e21ba608b3d4e3fb2142888e5ad882b. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:43:06.168987 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-3f130b9c-dbf4-4cd0-b72b-9eed96cf518c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Getting quotas for user 2e227950a67d49a1a7e9a5cc85c3b7bb and project 8e21ba608b3d4e3fb2142888e5ad882b. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:43:06.414613 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-3f130b9c-dbf4-4cd0-b72b-9eed96cf518c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Getting quotas for project 8e21ba608b3d4e3fb2142888e5ad882b. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:43:06.418478 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-3f130b9c-dbf4-4cd0-b72b-9eed96cf518c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Getting quotas for user 2e227950a67d49a1a7e9a5cc85c3b7bb and project 8e21ba608b3d4e3fb2142888e5ad882b. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:43:06.432153 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3f130b9c-dbf4-4cd0-b72b-9eed96cf518c tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.289863 Jul 19 09:43:06.432745 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 839/1650] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jul 19 09:43:06 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:06.748305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4cd33123-7e37-48d4-87b4-b12db45f5c41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:06.748912 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4cd33123-7e37-48d4-87b4-b12db45f5c41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:06.754604 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4cd33123-7e37-48d4-87b4-b12db45f5c41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:06.755073 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4cd33123-7e37-48d4-87b4-b12db45f5c41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:06.755848 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4cd33123-7e37-48d4-87b4-b12db45f5c41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:06.756285 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4cd33123-7e37-48d4-87b4-b12db45f5c41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:06.821229 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4cd33123-7e37-48d4-87b4-b12db45f5c41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:06.829185 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4cd33123-7e37-48d4-87b4-b12db45f5c41 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.084484 Jul 19 09:43:06.829750 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 812/1651] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:06 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:07.627356 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-40613594", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4f0d59c1-f731-491d-9154-db4b8e66a3e5"}], "security_groups": [{"name": "tempest-securitygroup--1080102444"}], "key_name": "tempest-keypair-1988494871", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:07.717437 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.network.neutron [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] validate_networks() for [('4f0d59c1-f731-491d-9154-db4b8e66a3e5', None, None, None)] {{(pid=107463) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:43:07.845393 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-408547e9-57ba-4549-9143-489d48047f6b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:07.846582 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-408547e9-57ba-4549-9143-489d48047f6b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:07.852885 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-408547e9-57ba-4549-9143-489d48047f6b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:07.853330 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-408547e9-57ba-4549-9143-489d48047f6b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:07.854112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-408547e9-57ba-4549-9143-489d48047f6b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:07.854521 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-408547e9-57ba-4549-9143-489d48047f6b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:07.914197 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-408547e9-57ba-4549-9143-489d48047f6b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:07.922283 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-408547e9-57ba-4549-9143-489d48047f6b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.080552 Jul 19 09:43:07.922840 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 813/1652] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:07 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:43:08.146964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Flavor limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:43:08.147561 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Image limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:43:08.148044 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Flavor pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:43:08.148840 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Image pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:43:08.149357 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:43:08.157854 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:08.158300 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:08.159131 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:08.160159 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:08.176997 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Getting quotas for project 8e21ba608b3d4e3fb2142888e5ad882b. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:43:08.181265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Getting quotas for user 2e227950a67d49a1a7e9a5cc85c3b7bb and project 8e21ba608b3d4e3fb2142888e5ad882b. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:43:08.192786 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Going to run 1 instances... {{(pid=107463) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:43:08.195123 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:43:08.244942 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a5ec8757-f719-40d4-ac9d-13db704bce5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.621523 Jul 19 09:43:08.245584 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 840/1653] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 09:43:07 2021] POST /compute/v2.1/servers => generated 402 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 09:43:08.255245 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-86f73929-a7d1-4e0f-9253-aae771f75a0d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:08.255836 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-86f73929-a7d1-4e0f-9253-aae771f75a0d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:08.308723 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-86f73929-a7d1-4e0f-9253-aae771f75a0d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:08.315268 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-86f73929-a7d1-4e0f-9253-aae771f75a0d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca" status: 200 len: 1236 microversion: 2.1 time: 0.063728 Jul 19 09:43:08.316345 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 814/1654] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:08 2021] GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca => generated 1236 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:08.939353 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1b19c771-56e3-4f6e-bbc5-07db5f98c283 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:08.939963 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1b19c771-56e3-4f6e-bbc5-07db5f98c283 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:08.946996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b19c771-56e3-4f6e-bbc5-07db5f98c283 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:08.947474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b19c771-56e3-4f6e-bbc5-07db5f98c283 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:08.948234 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b19c771-56e3-4f6e-bbc5-07db5f98c283 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:08.948762 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1b19c771-56e3-4f6e-bbc5-07db5f98c283 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:09.011165 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1b19c771-56e3-4f6e-bbc5-07db5f98c283 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:09.018829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1b19c771-56e3-4f6e-bbc5-07db5f98c283 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.083172 Jul 19 09:43:09.019438 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 841/1655] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:08 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:09.332926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c0722000-eca9-4c29-a2fa-18b61f9f2f5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:09.333535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c0722000-eca9-4c29-a2fa-18b61f9f2f5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:09.339447 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c0722000-eca9-4c29-a2fa-18b61f9f2f5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:09.339898 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c0722000-eca9-4c29-a2fa-18b61f9f2f5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:09.340693 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c0722000-eca9-4c29-a2fa-18b61f9f2f5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:09.341133 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c0722000-eca9-4c29-a2fa-18b61f9f2f5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:09.409981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c0722000-eca9-4c29-a2fa-18b61f9f2f5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:09.417463 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c0722000-eca9-4c29-a2fa-18b61f9f2f5d tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca" status: 200 len: 1294 microversion: 2.1 time: 0.088300 Jul 19 09:43:09.418024 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 815/1656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:09 2021] GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:10.034997 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8916faa7-0e77-4dd7-b359-c239d5cd9f9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:10.035595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8916faa7-0e77-4dd7-b359-c239d5cd9f9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:10.041891 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8916faa7-0e77-4dd7-b359-c239d5cd9f9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:10.042347 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8916faa7-0e77-4dd7-b359-c239d5cd9f9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:10.043140 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8916faa7-0e77-4dd7-b359-c239d5cd9f9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:10.043581 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8916faa7-0e77-4dd7-b359-c239d5cd9f9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:10.105105 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8916faa7-0e77-4dd7-b359-c239d5cd9f9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:10.113167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8916faa7-0e77-4dd7-b359-c239d5cd9f9e tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.081917 Jul 19 09:43:10.113735 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 842/1657] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:10 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:10.434755 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-86e5bfce-222e-4fd0-8fae-96f3c825d543 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:10.436016 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-86e5bfce-222e-4fd0-8fae-96f3c825d543 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:10.442681 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86e5bfce-222e-4fd0-8fae-96f3c825d543 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:10.443182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86e5bfce-222e-4fd0-8fae-96f3c825d543 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:10.444003 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86e5bfce-222e-4fd0-8fae-96f3c825d543 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:10.444447 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-86e5bfce-222e-4fd0-8fae-96f3c825d543 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:10.608213 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-c38d8d2c-a3aa-4f8e-98e7-b46904479e2a req-fc64879f-3835-4c36-bf05-2d5a96614c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cf3558d-149c-40e0-89da-b6def3a230ca", "tag": "63be8dfd-ab36-43a2-9cef-0376d44fd1f5"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:10.610779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:43:10.610779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:43:10.620110 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-c38d8d2c-a3aa-4f8e-98e7-b46904479e2a req-fc64879f-3835-4c36-bf05-2d5a96614c98 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:10.620551 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-c38d8d2c-a3aa-4f8e-98e7-b46904479e2a req-fc64879f-3835-4c36-bf05-2d5a96614c98 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:10.636184 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-c38d8d2c-a3aa-4f8e-98e7-b46904479e2a req-fc64879f-3835-4c36-bf05-2d5a96614c98 service nova] Creating event network-changed:63be8dfd-ab36-43a2-9cef-0376d44fd1f5 for instance 7cf3558d-149c-40e0-89da-b6def3a230ca on hv-cinder-79338 Jul 19 09:43:10.641081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-c38d8d2c-a3aa-4f8e-98e7-b46904479e2a req-fc64879f-3835-4c36-bf05-2d5a96614c98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036705 Jul 19 09:43:10.641842 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 843/1658] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:43:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:43:10.709112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-86e5bfce-222e-4fd0-8fae-96f3c825d543 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:10.725266 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-86e5bfce-222e-4fd0-8fae-96f3c825d543 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca" status: 200 len: 1362 microversion: 2.1 time: 0.294067 Jul 19 09:43:10.725855 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 816/1659] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:10 2021] GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:11.130875 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-151140b0-8a81-4430-914d-e84362a217bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:11.131511 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-151140b0-8a81-4430-914d-e84362a217bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:11.137636 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-151140b0-8a81-4430-914d-e84362a217bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:11.138334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-151140b0-8a81-4430-914d-e84362a217bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:11.139566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-151140b0-8a81-4430-914d-e84362a217bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:11.140072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-151140b0-8a81-4430-914d-e84362a217bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:11.202328 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-151140b0-8a81-4430-914d-e84362a217bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:11.210435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-151140b0-8a81-4430-914d-e84362a217bf tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.084414 Jul 19 09:43:11.211607 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 844/1660] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:11 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:11.740853 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6ecaaa80-7040-44e1-a44e-7398450d25e8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:11.741452 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6ecaaa80-7040-44e1-a44e-7398450d25e8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:11.747172 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ecaaa80-7040-44e1-a44e-7398450d25e8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:11.747624 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ecaaa80-7040-44e1-a44e-7398450d25e8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:11.748410 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ecaaa80-7040-44e1-a44e-7398450d25e8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:11.748845 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6ecaaa80-7040-44e1-a44e-7398450d25e8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:11.878660 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6ecaaa80-7040-44e1-a44e-7398450d25e8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:11.885710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6ecaaa80-7040-44e1-a44e-7398450d25e8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca" status: 200 len: 1362 microversion: 2.1 time: 0.148569 Jul 19 09:43:11.886268 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 817/1661] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:11 2021] GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:12.227843 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3b9c38ea-a417-4c5a-84e7-4be317f589ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:12.228453 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3b9c38ea-a417-4c5a-84e7-4be317f589ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:12.234267 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3b9c38ea-a417-4c5a-84e7-4be317f589ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:12.234720 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3b9c38ea-a417-4c5a-84e7-4be317f589ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:12.235509 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3b9c38ea-a417-4c5a-84e7-4be317f589ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:12.235940 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3b9c38ea-a417-4c5a-84e7-4be317f589ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:12.299979 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3b9c38ea-a417-4c5a-84e7-4be317f589ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:12.307587 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3b9c38ea-a417-4c5a-84e7-4be317f589ef tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.083447 Jul 19 09:43:12.308159 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 845/1662] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:12 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:12.902645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3108d08f-4c34-4986-ab5e-7181f937fe7f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:12.903383 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3108d08f-4c34-4986-ab5e-7181f937fe7f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:12.909181 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3108d08f-4c34-4986-ab5e-7181f937fe7f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:12.909707 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3108d08f-4c34-4986-ab5e-7181f937fe7f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:12.910480 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3108d08f-4c34-4986-ab5e-7181f937fe7f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:12.911446 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3108d08f-4c34-4986-ab5e-7181f937fe7f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:13.046886 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3108d08f-4c34-4986-ab5e-7181f937fe7f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:13.054704 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3108d08f-4c34-4986-ab5e-7181f937fe7f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca" status: 200 len: 1362 microversion: 2.1 time: 0.155854 Jul 19 09:43:13.055299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 818/1663] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:12 2021] GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:13.324636 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-81043539-e714-4418-9ef2-f0bce47c98f6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:13.325255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-81043539-e714-4418-9ef2-f0bce47c98f6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:13.336345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-81043539-e714-4418-9ef2-f0bce47c98f6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:13.336345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-81043539-e714-4418-9ef2-f0bce47c98f6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:13.336345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-81043539-e714-4418-9ef2-f0bce47c98f6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:13.336345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-81043539-e714-4418-9ef2-f0bce47c98f6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:13.397625 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-81043539-e714-4418-9ef2-f0bce47c98f6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:13.405267 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-81043539-e714-4418-9ef2-f0bce47c98f6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.084224 Jul 19 09:43:13.405851 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 846/1664] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:13 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:14.071600 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7db71533-38ff-429c-851b-443c3bbec4be tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:14.072222 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7db71533-38ff-429c-851b-443c3bbec4be tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:14.078034 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7db71533-38ff-429c-851b-443c3bbec4be tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:14.078486 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7db71533-38ff-429c-851b-443c3bbec4be tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:14.079278 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7db71533-38ff-429c-851b-443c3bbec4be tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:14.079719 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7db71533-38ff-429c-851b-443c3bbec4be tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:14.209518 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7db71533-38ff-429c-851b-443c3bbec4be tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:14.216675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7db71533-38ff-429c-851b-443c3bbec4be tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca" status: 200 len: 1362 microversion: 2.1 time: 0.148684 Jul 19 09:43:14.217245 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 819/1665] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:14 2021] GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:14.423119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3ff54eeb-9b57-4f71-b69c-9a776cf4f9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:14.423727 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3ff54eeb-9b57-4f71-b69c-9a776cf4f9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:14.429999 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3ff54eeb-9b57-4f71-b69c-9a776cf4f9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:14.430446 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3ff54eeb-9b57-4f71-b69c-9a776cf4f9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:14.431231 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3ff54eeb-9b57-4f71-b69c-9a776cf4f9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:14.431660 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3ff54eeb-9b57-4f71-b69c-9a776cf4f9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:14.492050 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3ff54eeb-9b57-4f71-b69c-9a776cf4f9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:14.499747 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3ff54eeb-9b57-4f71-b69c-9a776cf4f9cc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.080570 Jul 19 09:43:14.500308 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 847/1666] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:14 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:14.933879 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-d067bb13-4044-4918-97bc-b519a6d4112a req-b580f477-95d0-4245-b77c-b9f68b0df5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf3558d-149c-40e0-89da-b6def3a230ca", "name": "network-vif-plugged", "status": "completed", "tag": "63be8dfd-ab36-43a2-9cef-0376d44fd1f5"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:14.935607 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:43:14.935607 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:43:14.942376 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-d067bb13-4044-4918-97bc-b519a6d4112a req-b580f477-95d0-4245-b77c-b9f68b0df5a5 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:14.942823 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-d067bb13-4044-4918-97bc-b519a6d4112a req-b580f477-95d0-4245-b77c-b9f68b0df5a5 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:14.953632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-d067bb13-4044-4918-97bc-b519a6d4112a req-b580f477-95d0-4245-b77c-b9f68b0df5a5 service nova] Creating event network-vif-plugged:63be8dfd-ab36-43a2-9cef-0376d44fd1f5 for instance 7cf3558d-149c-40e0-89da-b6def3a230ca on hv-cinder-79338 Jul 19 09:43:14.958954 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-d067bb13-4044-4918-97bc-b519a6d4112a req-b580f477-95d0-4245-b77c-b9f68b0df5a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079146 Jul 19 09:43:14.959565 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 820/1667] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:43:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:43:15.233172 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-de6ee854-ea38-4c11-a0c3-1741a5c6a160 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:15.233775 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-de6ee854-ea38-4c11-a0c3-1741a5c6a160 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:15.239523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-de6ee854-ea38-4c11-a0c3-1741a5c6a160 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:15.239969 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-de6ee854-ea38-4c11-a0c3-1741a5c6a160 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:15.240721 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-de6ee854-ea38-4c11-a0c3-1741a5c6a160 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:15.241144 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-de6ee854-ea38-4c11-a0c3-1741a5c6a160 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:15.368939 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-de6ee854-ea38-4c11-a0c3-1741a5c6a160 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:15.376029 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-de6ee854-ea38-4c11-a0c3-1741a5c6a160 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca" status: 200 len: 1362 microversion: 2.1 time: 0.146644 Jul 19 09:43:15.376584 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 848/1668] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:15 2021] GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:15.516373 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ac50d927-fa38-4fd7-9860-637e7c5d9eb4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:15.517058 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ac50d927-fa38-4fd7-9860-637e7c5d9eb4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:15.523490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ac50d927-fa38-4fd7-9860-637e7c5d9eb4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:15.523933 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ac50d927-fa38-4fd7-9860-637e7c5d9eb4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:15.524682 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ac50d927-fa38-4fd7-9860-637e7c5d9eb4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:15.525109 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ac50d927-fa38-4fd7-9860-637e7c5d9eb4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:15.591136 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ac50d927-fa38-4fd7-9860-637e7c5d9eb4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:15.599837 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ac50d927-fa38-4fd7-9860-637e7c5d9eb4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.087409 Jul 19 09:43:15.600389 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 821/1669] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:15 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:16.392982 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d67804fc-ab67-4339-b723-3ce6cdfb57e6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:16.393591 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d67804fc-ab67-4339-b723-3ce6cdfb57e6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:16.399360 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d67804fc-ab67-4339-b723-3ce6cdfb57e6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:16.399808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d67804fc-ab67-4339-b723-3ce6cdfb57e6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:16.400556 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d67804fc-ab67-4339-b723-3ce6cdfb57e6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:16.400983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d67804fc-ab67-4339-b723-3ce6cdfb57e6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:16.540976 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d67804fc-ab67-4339-b723-3ce6cdfb57e6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:16.548198 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d67804fc-ab67-4339-b723-3ce6cdfb57e6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca" status: 200 len: 1549 microversion: 2.1 time: 0.158846 Jul 19 09:43:16.548757 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 849/1670] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:16 2021] GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:16.564291 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c45306a0-735e-44cd-bee9-53b3f1fe35f3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:16.564927 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c45306a0-735e-44cd-bee9-53b3f1fe35f3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:16.570816 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c45306a0-735e-44cd-bee9-53b3f1fe35f3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:16.571299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c45306a0-735e-44cd-bee9-53b3f1fe35f3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:16.572049 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c45306a0-735e-44cd-bee9-53b3f1fe35f3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:16.572477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c45306a0-735e-44cd-bee9-53b3f1fe35f3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:16.616592 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a6128dbd-8d5d-49c7-bae6-17a664e82f31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:16.617196 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a6128dbd-8d5d-49c7-bae6-17a664e82f31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:16.622941 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a6128dbd-8d5d-49c7-bae6-17a664e82f31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:16.623420 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a6128dbd-8d5d-49c7-bae6-17a664e82f31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:16.624176 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a6128dbd-8d5d-49c7-bae6-17a664e82f31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:16.624707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a6128dbd-8d5d-49c7-bae6-17a664e82f31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:16.663728 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c45306a0-735e-44cd-bee9-53b3f1fe35f3 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103007 Jul 19 09:43:16.664347 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 822/1671] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Jul 19 09:43:16 2021] GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:43:16.686633 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a6128dbd-8d5d-49c7-bae6-17a664e82f31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:16.694701 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a6128dbd-8d5d-49c7-bae6-17a664e82f31 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.082165 Jul 19 09:43:16.695345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 850/1672] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:16 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:43:17.588643 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fadfa101-2bd6-49c2-aff6-71c366f6bb65 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:17.589135 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-22e0ea45-05ca-4e01-afe2-b936a33f6a4e req-b163c1cc-e8a3-43be-99db-930cb23c66de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cf3558d-149c-40e0-89da-b6def3a230ca", "tag": "63be8dfd-ab36-43a2-9cef-0376d44fd1f5"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:17.590342 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:43:17.590342 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:43:17.591225 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fadfa101-2bd6-49c2-aff6-71c366f6bb65 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:17.597365 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fadfa101-2bd6-49c2-aff6-71c366f6bb65 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:17.597629 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-22e0ea45-05ca-4e01-afe2-b936a33f6a4e req-b163c1cc-e8a3-43be-99db-930cb23c66de service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:17.598014 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-22e0ea45-05ca-4e01-afe2-b936a33f6a4e req-b163c1cc-e8a3-43be-99db-930cb23c66de service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:17.598585 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fadfa101-2bd6-49c2-aff6-71c366f6bb65 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:17.599610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fadfa101-2bd6-49c2-aff6-71c366f6bb65 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:17.600264 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fadfa101-2bd6-49c2-aff6-71c366f6bb65 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:17.609711 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-22e0ea45-05ca-4e01-afe2-b936a33f6a4e req-b163c1cc-e8a3-43be-99db-930cb23c66de service nova] Creating event network-changed:63be8dfd-ab36-43a2-9cef-0376d44fd1f5 for instance 7cf3558d-149c-40e0-89da-b6def3a230ca on hv-cinder-79338 Jul 19 09:43:17.615525 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-22e0ea45-05ca-4e01-afe2-b936a33f6a4e req-b163c1cc-e8a3-43be-99db-930cb23c66de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030326 Jul 19 09:43:17.620290 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 851/1673] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:43:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:43:17.673438 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fadfa101-2bd6-49c2-aff6-71c366f6bb65 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 14 microversion: 2.1 time: 0.088093 Jul 19 09:43:17.677703 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 823/1674] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:17 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:43:17.712814 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7664402b-6dc8-434e-a5e3-ed393728972a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:17.713618 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7664402b-6dc8-434e-a5e3-ed393728972a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:17.719721 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7664402b-6dc8-434e-a5e3-ed393728972a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:17.720474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7664402b-6dc8-434e-a5e3-ed393728972a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:17.721318 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7664402b-6dc8-434e-a5e3-ed393728972a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:17.721836 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7664402b-6dc8-434e-a5e3-ed393728972a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:17.785118 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7664402b-6dc8-434e-a5e3-ed393728972a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:17.793422 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7664402b-6dc8-434e-a5e3-ed393728972a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.084642 Jul 19 09:43:17.803152 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 852/1675] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:17 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:18.693937 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fc45c8e5-04d1-4ff4-8f83-7dc0ebeb16ae tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:18.694852 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fc45c8e5-04d1-4ff4-8f83-7dc0ebeb16ae tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:18.701657 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc45c8e5-04d1-4ff4-8f83-7dc0ebeb16ae tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:18.702112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc45c8e5-04d1-4ff4-8f83-7dc0ebeb16ae tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:18.702887 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc45c8e5-04d1-4ff4-8f83-7dc0ebeb16ae tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:18.703407 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc45c8e5-04d1-4ff4-8f83-7dc0ebeb16ae tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:18.763198 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fc45c8e5-04d1-4ff4-8f83-7dc0ebeb16ae tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 14 microversion: 2.1 time: 0.073711 Jul 19 09:43:18.763762 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 824/1676] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:18 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:43:18.809969 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-de501e7f-868d-464f-9199-f08acc5f91e8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:18.810574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-de501e7f-868d-464f-9199-f08acc5f91e8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:18.812960 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 09:43:18.817343 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-de501e7f-868d-464f-9199-f08acc5f91e8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:18.817794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-de501e7f-868d-464f-9199-f08acc5f91e8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:18.818552 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-de501e7f-868d-464f-9199-f08acc5f91e8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:18.818985 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-de501e7f-868d-464f-9199-f08acc5f91e8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:18.877192 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-de501e7f-868d-464f-9199-f08acc5f91e8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:18.884644 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-de501e7f-868d-464f-9199-f08acc5f91e8 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078262 Jul 19 09:43:18.885206 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 853/1677] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:18 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:19.773977 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-60e3e7bc-a7c5-4399-9703-08b9f2f309d9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:19.775006 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-60e3e7bc-a7c5-4399-9703-08b9f2f309d9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:19.781420 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-60e3e7bc-a7c5-4399-9703-08b9f2f309d9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:19.781869 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-60e3e7bc-a7c5-4399-9703-08b9f2f309d9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:19.782630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-60e3e7bc-a7c5-4399-9703-08b9f2f309d9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:19.783085 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-60e3e7bc-a7c5-4399-9703-08b9f2f309d9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:19.841281 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-60e3e7bc-a7c5-4399-9703-08b9f2f309d9 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 14 microversion: 2.1 time: 0.071050 Jul 19 09:43:19.841801 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 825/1678] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:19 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:43:19.917161 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59242. Jul 19 09:43:20.013231 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d0669dd9-094f-4c4b-8d54-55259a716543 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:20.013840 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d0669dd9-094f-4c4b-8d54-55259a716543 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:20.020268 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d0669dd9-094f-4c4b-8d54-55259a716543 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:20.020719 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d0669dd9-094f-4c4b-8d54-55259a716543 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:20.021476 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d0669dd9-094f-4c4b-8d54-55259a716543 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:20.021908 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d0669dd9-094f-4c4b-8d54-55259a716543 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:20.084871 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d0669dd9-094f-4c4b-8d54-55259a716543 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:20.092508 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d0669dd9-094f-4c4b-8d54-55259a716543 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.195412 Jul 19 09:43:20.093010 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 854/1679] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:19 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:20.852168 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-08ca93a6-1c5e-4e25-aa84-f126f3389f37 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:20.853158 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-08ca93a6-1c5e-4e25-aa84-f126f3389f37 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:20.859529 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08ca93a6-1c5e-4e25-aa84-f126f3389f37 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:20.859980 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08ca93a6-1c5e-4e25-aa84-f126f3389f37 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:20.860741 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08ca93a6-1c5e-4e25-aa84-f126f3389f37 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:20.861177 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-08ca93a6-1c5e-4e25-aa84-f126f3389f37 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:20.925686 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-08ca93a6-1c5e-4e25-aa84-f126f3389f37 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 14 microversion: 2.1 time: 0.077464 Jul 19 09:43:20.926771 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 826/1680] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:20 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:43:21.108504 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c1f6cac1-4e61-478a-a187-d8ff21543042 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:21.109041 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c1f6cac1-4e61-478a-a187-d8ff21543042 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:21.115447 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1f6cac1-4e61-478a-a187-d8ff21543042 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:21.115897 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1f6cac1-4e61-478a-a187-d8ff21543042 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:21.116656 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1f6cac1-4e61-478a-a187-d8ff21543042 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:21.117087 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1f6cac1-4e61-478a-a187-d8ff21543042 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:21.176535 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c1f6cac1-4e61-478a-a187-d8ff21543042 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:21.184206 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c1f6cac1-4e61-478a-a187-d8ff21543042 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079509 Jul 19 09:43:21.184770 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 855/1681] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:21 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:21.936931 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a8022894-3164-438f-939f-f803f5ac7aed tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:21.937926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a8022894-3164-438f-939f-f803f5ac7aed tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:21.944837 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a8022894-3164-438f-939f-f803f5ac7aed tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:21.945290 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a8022894-3164-438f-939f-f803f5ac7aed tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:21.946104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a8022894-3164-438f-939f-f803f5ac7aed tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:21.946599 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a8022894-3164-438f-939f-f803f5ac7aed tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:22.005645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a8022894-3164-438f-939f-f803f5ac7aed tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 14 microversion: 2.1 time: 0.072490 Jul 19 09:43:22.006204 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 827/1682] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:21 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:43:22.200553 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-449122c8-408a-45e4-8b25-463af01facf0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:22.201164 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-449122c8-408a-45e4-8b25-463af01facf0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:22.207328 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-449122c8-408a-45e4-8b25-463af01facf0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:22.207789 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-449122c8-408a-45e4-8b25-463af01facf0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:22.208572 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-449122c8-408a-45e4-8b25-463af01facf0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:22.209007 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-449122c8-408a-45e4-8b25-463af01facf0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:22.268478 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-449122c8-408a-45e4-8b25-463af01facf0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:22.275942 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-449122c8-408a-45e4-8b25-463af01facf0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079104 Jul 19 09:43:22.276710 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 856/1683] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:22 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:23.016675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4485074a-c43d-4807-af33-eda3d2b4e134 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:23.017598 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4485074a-c43d-4807-af33-eda3d2b4e134 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:23.024458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4485074a-c43d-4807-af33-eda3d2b4e134 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:23.024908 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4485074a-c43d-4807-af33-eda3d2b4e134 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:23.025675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4485074a-c43d-4807-af33-eda3d2b4e134 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:23.026110 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4485074a-c43d-4807-af33-eda3d2b4e134 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:23.081605 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4485074a-c43d-4807-af33-eda3d2b4e134 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 14 microversion: 2.1 time: 0.068941 Jul 19 09:43:23.082188 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 828/1684] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:23 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:43:23.292439 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1c881307-808b-4bc3-a3bb-8b0f1cd1b12a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:23.292989 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1c881307-808b-4bc3-a3bb-8b0f1cd1b12a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:23.298827 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c881307-808b-4bc3-a3bb-8b0f1cd1b12a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:23.299319 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c881307-808b-4bc3-a3bb-8b0f1cd1b12a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:23.300094 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c881307-808b-4bc3-a3bb-8b0f1cd1b12a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:23.300528 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1c881307-808b-4bc3-a3bb-8b0f1cd1b12a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:23.359706 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1c881307-808b-4bc3-a3bb-8b0f1cd1b12a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:23.367249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1c881307-808b-4bc3-a3bb-8b0f1cd1b12a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078820 Jul 19 09:43:23.367812 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 857/1685] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:23 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:24.093077 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9ea74007-eb23-457a-a643-91e8b09ca2f6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:24.094102 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9ea74007-eb23-457a-a643-91e8b09ca2f6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:24.100966 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ea74007-eb23-457a-a643-91e8b09ca2f6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:24.101425 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ea74007-eb23-457a-a643-91e8b09ca2f6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:24.102192 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ea74007-eb23-457a-a643-91e8b09ca2f6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:24.102628 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ea74007-eb23-457a-a643-91e8b09ca2f6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:24.161215 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9ea74007-eb23-457a-a643-91e8b09ca2f6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 14 microversion: 2.1 time: 0.071432 Jul 19 09:43:24.161862 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 829/1686] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:24 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:43:24.383153 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ba7578a8-c3fb-4f11-a193-a4f90dbeea49 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:24.383764 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ba7578a8-c3fb-4f11-a193-a4f90dbeea49 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:24.389457 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ba7578a8-c3fb-4f11-a193-a4f90dbeea49 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:24.389902 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ba7578a8-c3fb-4f11-a193-a4f90dbeea49 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:24.390659 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ba7578a8-c3fb-4f11-a193-a4f90dbeea49 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:24.391109 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ba7578a8-c3fb-4f11-a193-a4f90dbeea49 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:24.452677 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ba7578a8-c3fb-4f11-a193-a4f90dbeea49 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:24.460710 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ba7578a8-c3fb-4f11-a193-a4f90dbeea49 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.081190 Jul 19 09:43:24.461273 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 858/1687] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:24 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:25.172308 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-dc7cfe8f-0945-4e2b-8067-c84884f0e369 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:25.173287 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-dc7cfe8f-0945-4e2b-8067-c84884f0e369 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:25.180167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dc7cfe8f-0945-4e2b-8067-c84884f0e369 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:25.180606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dc7cfe8f-0945-4e2b-8067-c84884f0e369 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:25.181358 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dc7cfe8f-0945-4e2b-8067-c84884f0e369 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:25.181784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-dc7cfe8f-0945-4e2b-8067-c84884f0e369 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:25.245971 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-dc7cfe8f-0945-4e2b-8067-c84884f0e369 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 14 microversion: 2.1 time: 0.077533 Jul 19 09:43:25.246580 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 830/1688] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:25 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:43:25.476956 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-81c0e51b-3aa7-4b28-8b91-d88ffc5de944 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:25.477546 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-81c0e51b-3aa7-4b28-8b91-d88ffc5de944 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:25.483431 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-81c0e51b-3aa7-4b28-8b91-d88ffc5de944 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:25.483874 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-81c0e51b-3aa7-4b28-8b91-d88ffc5de944 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:25.484625 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-81c0e51b-3aa7-4b28-8b91-d88ffc5de944 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:25.485071 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-81c0e51b-3aa7-4b28-8b91-d88ffc5de944 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:25.545179 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-81c0e51b-3aa7-4b28-8b91-d88ffc5de944 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:25.553226 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-81c0e51b-3aa7-4b28-8b91-d88ffc5de944 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.080073 Jul 19 09:43:25.553779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 859/1689] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:25 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:26.257535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-04d3726c-1b8a-43f0-8be0-e5ca552863f4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:26.258556 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-04d3726c-1b8a-43f0-8be0-e5ca552863f4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:26.264954 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-04d3726c-1b8a-43f0-8be0-e5ca552863f4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:26.265400 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-04d3726c-1b8a-43f0-8be0-e5ca552863f4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:26.266159 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-04d3726c-1b8a-43f0-8be0-e5ca552863f4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:26.266589 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-04d3726c-1b8a-43f0-8be0-e5ca552863f4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:26.329750 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-04d3726c-1b8a-43f0-8be0-e5ca552863f4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 14 microversion: 2.1 time: 0.076110 Jul 19 09:43:26.330546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 831/1690] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:26 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 09:43:26.569836 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a90d607e-0f32-4879-b28f-867cf0171ced tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:26.570447 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a90d607e-0f32-4879-b28f-867cf0171ced tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:26.576293 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a90d607e-0f32-4879-b28f-867cf0171ced tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:26.576745 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a90d607e-0f32-4879-b28f-867cf0171ced tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:26.577508 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a90d607e-0f32-4879-b28f-867cf0171ced tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:26.577943 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a90d607e-0f32-4879-b28f-867cf0171ced tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:26.636665 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a90d607e-0f32-4879-b28f-867cf0171ced tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:26.644040 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a90d607e-0f32-4879-b28f-867cf0171ced tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078405 Jul 19 09:43:26.644600 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 860/1691] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:26 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:27.341596 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4df74897-e33e-48d3-a6f1-51916a702d7b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:27.342509 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4df74897-e33e-48d3-a6f1-51916a702d7b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:27.349400 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4df74897-e33e-48d3-a6f1-51916a702d7b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:27.349846 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4df74897-e33e-48d3-a6f1-51916a702d7b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:27.350618 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4df74897-e33e-48d3-a6f1-51916a702d7b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:27.351069 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4df74897-e33e-48d3-a6f1-51916a702d7b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:27.417637 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4df74897-e33e-48d3-a6f1-51916a702d7b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 2778 microversion: 2.1 time: 0.080089 Jul 19 09:43:27.418223 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 832/1692] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:27 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 2778 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:27.661421 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-971e72c0-c490-41e9-80b6-56cab091d35a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:27.662026 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-971e72c0-c490-41e9-80b6-56cab091d35a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:27.668072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-971e72c0-c490-41e9-80b6-56cab091d35a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:27.668515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-971e72c0-c490-41e9-80b6-56cab091d35a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:27.669267 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-971e72c0-c490-41e9-80b6-56cab091d35a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:27.669689 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-971e72c0-c490-41e9-80b6-56cab091d35a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:27.728841 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-971e72c0-c490-41e9-80b6-56cab091d35a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:27.736410 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-971e72c0-c490-41e9-80b6-56cab091d35a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079224 Jul 19 09:43:27.736971 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 861/1693] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:27 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:28.429351 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ff9f5f53-282c-46a7-9a07-f678e438a4e7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:28.430376 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ff9f5f53-282c-46a7-9a07-f678e438a4e7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:28.436778 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ff9f5f53-282c-46a7-9a07-f678e438a4e7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:28.437229 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ff9f5f53-282c-46a7-9a07-f678e438a4e7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:28.437989 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ff9f5f53-282c-46a7-9a07-f678e438a4e7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:28.438427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ff9f5f53-282c-46a7-9a07-f678e438a4e7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:28.500122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ff9f5f53-282c-46a7-9a07-f678e438a4e7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 15025 microversion: 2.1 time: 0.075148 Jul 19 09:43:28.500742 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 833/1694] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:28 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 15025 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:28.752610 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-655a4758-99a8-48fe-8ea0-00966128a6b0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:28.753212 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-655a4758-99a8-48fe-8ea0-00966128a6b0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:28.759077 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-655a4758-99a8-48fe-8ea0-00966128a6b0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:28.759517 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-655a4758-99a8-48fe-8ea0-00966128a6b0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:28.760265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-655a4758-99a8-48fe-8ea0-00966128a6b0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:28.760690 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-655a4758-99a8-48fe-8ea0-00966128a6b0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:28.822389 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-655a4758-99a8-48fe-8ea0-00966128a6b0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:28.829888 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-655a4758-99a8-48fe-8ea0-00966128a6b0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.080987 Jul 19 09:43:28.830451 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 862/1695] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:28 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:43:29.511470 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-da7a0d84-ad9f-49fd-b347-0a3237e75c3b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:29.512465 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-da7a0d84-ad9f-49fd-b347-0a3237e75c3b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:29.518792 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-da7a0d84-ad9f-49fd-b347-0a3237e75c3b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:29.519258 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-da7a0d84-ad9f-49fd-b347-0a3237e75c3b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:29.520657 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-da7a0d84-ad9f-49fd-b347-0a3237e75c3b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:29.521090 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-da7a0d84-ad9f-49fd-b347-0a3237e75c3b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:29.582351 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-da7a0d84-ad9f-49fd-b347-0a3237e75c3b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 18608 microversion: 2.1 time: 0.074678 Jul 19 09:43:29.583483 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 834/1696] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:29 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 18608 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:29.845895 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d5186638-cf76-427a-b764-24019bd60529 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:29.846469 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d5186638-cf76-427a-b764-24019bd60529 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:29.852288 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d5186638-cf76-427a-b764-24019bd60529 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:29.852742 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d5186638-cf76-427a-b764-24019bd60529 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:29.853525 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d5186638-cf76-427a-b764-24019bd60529 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:29.853953 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d5186638-cf76-427a-b764-24019bd60529 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:29.912483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d5186638-cf76-427a-b764-24019bd60529 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:29.920332 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d5186638-cf76-427a-b764-24019bd60529 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078106 Jul 19 09:43:29.920895 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 863/1697] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:29 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:30.594620 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-813ac0c7-5ff3-45db-a653-8128f2ad70b8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:30.595717 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-813ac0c7-5ff3-45db-a653-8128f2ad70b8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:30.602739 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-813ac0c7-5ff3-45db-a653-8128f2ad70b8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:30.603229 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-813ac0c7-5ff3-45db-a653-8128f2ad70b8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:30.603998 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-813ac0c7-5ff3-45db-a653-8128f2ad70b8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:30.604431 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-813ac0c7-5ff3-45db-a653-8128f2ad70b8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:30.663360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-813ac0c7-5ff3-45db-a653-8128f2ad70b8 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 19342 microversion: 2.1 time: 0.072525 Jul 19 09:43:30.667311 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 835/1698] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:30 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 19342 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:30.937113 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-427aa5ab-45b3-4c1e-92fb-a2a8709a56bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:30.937714 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-427aa5ab-45b3-4c1e-92fb-a2a8709a56bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:30.943999 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-427aa5ab-45b3-4c1e-92fb-a2a8709a56bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:30.944471 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-427aa5ab-45b3-4c1e-92fb-a2a8709a56bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:30.945215 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-427aa5ab-45b3-4c1e-92fb-a2a8709a56bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:30.945644 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-427aa5ab-45b3-4c1e-92fb-a2a8709a56bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:31.005135 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-427aa5ab-45b3-4c1e-92fb-a2a8709a56bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:31.012756 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-427aa5ab-45b3-4c1e-92fb-a2a8709a56bd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079427 Jul 19 09:43:31.013310 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 864/1699] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:30 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:31.675326 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-53b85b90-7c2f-435c-9a11-4001e458d05e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:31.676934 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-53b85b90-7c2f-435c-9a11-4001e458d05e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:31.683270 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-53b85b90-7c2f-435c-9a11-4001e458d05e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:31.683714 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-53b85b90-7c2f-435c-9a11-4001e458d05e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:31.684463 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-53b85b90-7c2f-435c-9a11-4001e458d05e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:31.684894 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-53b85b90-7c2f-435c-9a11-4001e458d05e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:31.742535 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-53b85b90-7c2f-435c-9a11-4001e458d05e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 22217 microversion: 2.1 time: 0.071153 Jul 19 09:43:31.743152 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 836/1700] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:31 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 22217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:43:32.029461 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b7ccc4ad-5045-4046-bdbc-4fd2caf61d8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:32.029983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b7ccc4ad-5045-4046-bdbc-4fd2caf61d8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:32.036245 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7ccc4ad-5045-4046-bdbc-4fd2caf61d8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:32.036694 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7ccc4ad-5045-4046-bdbc-4fd2caf61d8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:32.037452 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7ccc4ad-5045-4046-bdbc-4fd2caf61d8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:32.037883 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7ccc4ad-5045-4046-bdbc-4fd2caf61d8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:32.096609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b7ccc4ad-5045-4046-bdbc-4fd2caf61d8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:32.104807 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b7ccc4ad-5045-4046-bdbc-4fd2caf61d8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079048 Jul 19 09:43:32.105379 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 865/1701] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:32 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:32.755114 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d98d63b4-3e63-4441-9040-eab90bb22e63 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:32.756105 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d98d63b4-3e63-4441-9040-eab90bb22e63 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:32.762567 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d98d63b4-3e63-4441-9040-eab90bb22e63 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:32.763014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d98d63b4-3e63-4441-9040-eab90bb22e63 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:32.763800 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d98d63b4-3e63-4441-9040-eab90bb22e63 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:32.764232 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d98d63b4-3e63-4441-9040-eab90bb22e63 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:32.824057 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d98d63b4-3e63-4441-9040-eab90bb22e63 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 23804 microversion: 2.1 time: 0.073407 Jul 19 09:43:32.824590 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 837/1702] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:32 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 23804 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:33.121610 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-091e48b2-3c97-4c99-a43e-70eec9c8f327 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:33.122144 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-091e48b2-3c97-4c99-a43e-70eec9c8f327 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:33.127861 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-091e48b2-3c97-4c99-a43e-70eec9c8f327 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:33.128305 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-091e48b2-3c97-4c99-a43e-70eec9c8f327 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:33.129057 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-091e48b2-3c97-4c99-a43e-70eec9c8f327 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:33.129480 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-091e48b2-3c97-4c99-a43e-70eec9c8f327 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:33.191542 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-091e48b2-3c97-4c99-a43e-70eec9c8f327 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:33.199126 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-091e48b2-3c97-4c99-a43e-70eec9c8f327 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.081207 Jul 19 09:43:33.199679 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 866/1703] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:33 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:33.836410 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fc5b98fc-ea04-437f-853f-480ed7db9b1e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:33.837405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fc5b98fc-ea04-437f-853f-480ed7db9b1e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:33.843939 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc5b98fc-ea04-437f-853f-480ed7db9b1e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:33.844392 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc5b98fc-ea04-437f-853f-480ed7db9b1e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:33.845155 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc5b98fc-ea04-437f-853f-480ed7db9b1e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:33.845593 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fc5b98fc-ea04-437f-853f-480ed7db9b1e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:33.905568 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fc5b98fc-ea04-437f-853f-480ed7db9b1e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 25388 microversion: 2.1 time: 0.073675 Jul 19 09:43:33.906207 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 838/1704] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:33 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 25388 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:34.215475 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a83cdb2e-d71c-4fc7-b6e4-e4f3be4afce7 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:34.216077 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a83cdb2e-d71c-4fc7-b6e4-e4f3be4afce7 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:34.221821 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a83cdb2e-d71c-4fc7-b6e4-e4f3be4afce7 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:34.222261 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a83cdb2e-d71c-4fc7-b6e4-e4f3be4afce7 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:34.223052 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a83cdb2e-d71c-4fc7-b6e4-e4f3be4afce7 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:34.223478 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a83cdb2e-d71c-4fc7-b6e4-e4f3be4afce7 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:34.282418 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a83cdb2e-d71c-4fc7-b6e4-e4f3be4afce7 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:34.290168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a83cdb2e-d71c-4fc7-b6e4-e4f3be4afce7 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078057 Jul 19 09:43:34.290721 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 867/1705] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:34 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:34.918344 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9d9eae50-2478-4850-8fa7-ef3985a4c25f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:34.919473 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9d9eae50-2478-4850-8fa7-ef3985a4c25f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:34.925790 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d9eae50-2478-4850-8fa7-ef3985a4c25f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:34.926243 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d9eae50-2478-4850-8fa7-ef3985a4c25f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:34.926993 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d9eae50-2478-4850-8fa7-ef3985a4c25f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:34.927447 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9d9eae50-2478-4850-8fa7-ef3985a4c25f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:34.986906 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9d9eae50-2478-4850-8fa7-ef3985a4c25f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 26810 microversion: 2.1 time: 0.072723 Jul 19 09:43:34.987569 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 839/1706] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:34 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 26810 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:35.209620 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:43:35.209785 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:43:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:43:35.306310 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bbb40751-e92e-4447-9e63-f2bd427731c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:35.306923 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bbb40751-e92e-4447-9e63-f2bd427731c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:35.312751 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbb40751-e92e-4447-9e63-f2bd427731c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:35.313203 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbb40751-e92e-4447-9e63-f2bd427731c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:35.313962 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbb40751-e92e-4447-9e63-f2bd427731c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:35.314397 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbb40751-e92e-4447-9e63-f2bd427731c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:35.373546 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bbb40751-e92e-4447-9e63-f2bd427731c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:35.381701 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bbb40751-e92e-4447-9e63-f2bd427731c1 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078986 Jul 19 09:43:35.382537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 868/1707] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:35 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:35.998712 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-76b1b064-ea7e-495e-9c45-f1d36698aa12 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:35.999761 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-76b1b064-ea7e-495e-9c45-f1d36698aa12 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:36.006772 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-76b1b064-ea7e-495e-9c45-f1d36698aa12 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:36.007250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-76b1b064-ea7e-495e-9c45-f1d36698aa12 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:36.008021 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-76b1b064-ea7e-495e-9c45-f1d36698aa12 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:36.008456 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-76b1b064-ea7e-495e-9c45-f1d36698aa12 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:36.067648 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-76b1b064-ea7e-495e-9c45-f1d36698aa12 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 27701 microversion: 2.1 time: 0.072744 Jul 19 09:43:36.068237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 840/1708] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:35 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 27701 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:43:36.404322 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-933d1b0c-40df-404b-9c40-470d5c015898 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:36.404732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-933d1b0c-40df-404b-9c40-470d5c015898 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:36.410428 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-933d1b0c-40df-404b-9c40-470d5c015898 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:36.410906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-933d1b0c-40df-404b-9c40-470d5c015898 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:36.412333 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-933d1b0c-40df-404b-9c40-470d5c015898 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:36.412762 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-933d1b0c-40df-404b-9c40-470d5c015898 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:36.478392 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-933d1b0c-40df-404b-9c40-470d5c015898 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:36.486736 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-933d1b0c-40df-404b-9c40-470d5c015898 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.093002 Jul 19 09:43:36.487454 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 869/1709] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:36 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:43:37.079782 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f0b30e39-a5ea-4b9e-b22a-d4ffd2d882c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:37.080774 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f0b30e39-a5ea-4b9e-b22a-d4ffd2d882c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:37.087806 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f0b30e39-a5ea-4b9e-b22a-d4ffd2d882c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:37.088255 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f0b30e39-a5ea-4b9e-b22a-d4ffd2d882c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:37.089016 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f0b30e39-a5ea-4b9e-b22a-d4ffd2d882c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:37.089457 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f0b30e39-a5ea-4b9e-b22a-d4ffd2d882c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:37.149618 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f0b30e39-a5ea-4b9e-b22a-d4ffd2d882c5 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 28183 microversion: 2.1 time: 0.073780 Jul 19 09:43:37.150238 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 841/1710] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:37 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 28183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:37.502894 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9350dc12-76ce-447d-a02e-081398a2f0f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:37.503541 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9350dc12-76ce-447d-a02e-081398a2f0f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:37.509955 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9350dc12-76ce-447d-a02e-081398a2f0f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:37.510408 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9350dc12-76ce-447d-a02e-081398a2f0f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:37.511204 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9350dc12-76ce-447d-a02e-081398a2f0f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:37.511779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9350dc12-76ce-447d-a02e-081398a2f0f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:37.574754 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9350dc12-76ce-447d-a02e-081398a2f0f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:37.582651 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9350dc12-76ce-447d-a02e-081398a2f0f0 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.083342 Jul 19 09:43:37.583248 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 870/1711] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:37 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:38.162201 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-077fb39c-55c4-4121-bb6e-b331ef3709d6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:38.163227 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-077fb39c-55c4-4121-bb6e-b331ef3709d6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:38.170166 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-077fb39c-55c4-4121-bb6e-b331ef3709d6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:38.170620 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-077fb39c-55c4-4121-bb6e-b331ef3709d6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:38.171427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-077fb39c-55c4-4121-bb6e-b331ef3709d6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:38.171864 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-077fb39c-55c4-4121-bb6e-b331ef3709d6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:38.231870 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-077fb39c-55c4-4121-bb6e-b331ef3709d6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 28183 microversion: 2.1 time: 0.074137 Jul 19 09:43:38.232468 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 842/1712] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:38 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 28183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:38.606782 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8cbed7e9-f029-42e2-8f8c-67eb2e911229 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:38.607467 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8cbed7e9-f029-42e2-8f8c-67eb2e911229 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:38.613253 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8cbed7e9-f029-42e2-8f8c-67eb2e911229 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:38.613708 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8cbed7e9-f029-42e2-8f8c-67eb2e911229 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:38.614481 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8cbed7e9-f029-42e2-8f8c-67eb2e911229 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:38.614916 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8cbed7e9-f029-42e2-8f8c-67eb2e911229 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:38.675060 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8cbed7e9-f029-42e2-8f8c-67eb2e911229 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:38.683469 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8cbed7e9-f029-42e2-8f8c-67eb2e911229 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.080297 Jul 19 09:43:38.684032 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 871/1713] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:38 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:39.243614 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3273fa39-4e85-45e0-addb-107e3722f7ee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:39.244629 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3273fa39-4e85-45e0-addb-107e3722f7ee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:39.251054 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3273fa39-4e85-45e0-addb-107e3722f7ee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:39.251509 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3273fa39-4e85-45e0-addb-107e3722f7ee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:39.252263 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3273fa39-4e85-45e0-addb-107e3722f7ee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:39.252693 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3273fa39-4e85-45e0-addb-107e3722f7ee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:39.310928 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3273fa39-4e85-45e0-addb-107e3722f7ee tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 28473 microversion: 2.1 time: 0.071806 Jul 19 09:43:39.311575 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 843/1714] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:39 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 28473 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:39.700078 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-95237d76-d5a9-498f-a169-35a6a254e2ce tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:39.700799 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-95237d76-d5a9-498f-a169-35a6a254e2ce tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:39.706445 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-95237d76-d5a9-498f-a169-35a6a254e2ce tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:39.707138 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-95237d76-d5a9-498f-a169-35a6a254e2ce tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:39.707680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-95237d76-d5a9-498f-a169-35a6a254e2ce tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:39.708621 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-95237d76-d5a9-498f-a169-35a6a254e2ce tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:39.767729 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-95237d76-d5a9-498f-a169-35a6a254e2ce tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:39.776147 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-95237d76-d5a9-498f-a169-35a6a254e2ce tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079615 Jul 19 09:43:39.776740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 872/1715] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:39 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:40.322753 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7509f2e3-ca94-40d5-ac7e-4bf42f0316a6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:40.323780 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7509f2e3-ca94-40d5-ac7e-4bf42f0316a6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:40.330179 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7509f2e3-ca94-40d5-ac7e-4bf42f0316a6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:40.330630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7509f2e3-ca94-40d5-ac7e-4bf42f0316a6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:40.331423 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7509f2e3-ca94-40d5-ac7e-4bf42f0316a6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:40.331857 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7509f2e3-ca94-40d5-ac7e-4bf42f0316a6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:40.391270 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7509f2e3-ca94-40d5-ac7e-4bf42f0316a6 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 28641 microversion: 2.1 time: 0.072402 Jul 19 09:43:40.391871 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 844/1716] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:40 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 28641 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:40.792632 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e046f173-c7ad-46bf-bd50-d3ffe4bf4e34 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:40.793284 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e046f173-c7ad-46bf-bd50-d3ffe4bf4e34 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:40.799056 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e046f173-c7ad-46bf-bd50-d3ffe4bf4e34 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:40.799528 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e046f173-c7ad-46bf-bd50-d3ffe4bf4e34 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:40.800281 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e046f173-c7ad-46bf-bd50-d3ffe4bf4e34 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:40.800707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e046f173-c7ad-46bf-bd50-d3ffe4bf4e34 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:40.859822 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e046f173-c7ad-46bf-bd50-d3ffe4bf4e34 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:40.868005 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e046f173-c7ad-46bf-bd50-d3ffe4bf4e34 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079450 Jul 19 09:43:40.868559 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 873/1717] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:40 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:41.403116 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ebfe1e89-4847-4ba7-8891-451f22b40efa tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:41.404110 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ebfe1e89-4847-4ba7-8891-451f22b40efa tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:41.410519 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ebfe1e89-4847-4ba7-8891-451f22b40efa tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:41.410967 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ebfe1e89-4847-4ba7-8891-451f22b40efa tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:41.411761 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ebfe1e89-4847-4ba7-8891-451f22b40efa tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:41.412199 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ebfe1e89-4847-4ba7-8891-451f22b40efa tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:41.483536 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ebfe1e89-4847-4ba7-8891-451f22b40efa tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 28641 microversion: 2.1 time: 0.084299 Jul 19 09:43:41.484078 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 845/1718] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:41 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 28641 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:41.884652 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9130c26c-aa8a-41d0-9b41-27b00343b53f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:41.885317 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9130c26c-aa8a-41d0-9b41-27b00343b53f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:41.890997 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9130c26c-aa8a-41d0-9b41-27b00343b53f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:41.891482 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9130c26c-aa8a-41d0-9b41-27b00343b53f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:41.892246 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9130c26c-aa8a-41d0-9b41-27b00343b53f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:41.892682 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9130c26c-aa8a-41d0-9b41-27b00343b53f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:41.954456 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9130c26c-aa8a-41d0-9b41-27b00343b53f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:41.961988 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9130c26c-aa8a-41d0-9b41-27b00343b53f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.080972 Jul 19 09:43:41.962548 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 874/1719] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:41 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:42.494729 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8262fec9-6d69-4d3b-a4f8-4d957768a3df tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:42.495745 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8262fec9-6d69-4d3b-a4f8-4d957768a3df tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:42.502091 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8262fec9-6d69-4d3b-a4f8-4d957768a3df tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:42.502537 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8262fec9-6d69-4d3b-a4f8-4d957768a3df tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:42.503324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8262fec9-6d69-4d3b-a4f8-4d957768a3df tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:42.503750 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8262fec9-6d69-4d3b-a4f8-4d957768a3df tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:42.565057 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8262fec9-6d69-4d3b-a4f8-4d957768a3df tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 28641 microversion: 2.1 time: 0.074207 Jul 19 09:43:42.565675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 846/1720] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:42 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 28641 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:42.977981 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-32319307-edd8-4a34-a63b-0309402b8d9d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:42.978582 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-32319307-edd8-4a34-a63b-0309402b8d9d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:42.984459 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-32319307-edd8-4a34-a63b-0309402b8d9d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:42.984905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-32319307-edd8-4a34-a63b-0309402b8d9d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:42.985660 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-32319307-edd8-4a34-a63b-0309402b8d9d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:42.986085 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-32319307-edd8-4a34-a63b-0309402b8d9d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:43.045833 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-32319307-edd8-4a34-a63b-0309402b8d9d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:43.053352 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-32319307-edd8-4a34-a63b-0309402b8d9d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078948 Jul 19 09:43:43.053908 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 875/1721] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:42 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:43.577038 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5be44d11-8069-46f1-98ca-edc72b3330ab tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:43.578022 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5be44d11-8069-46f1-98ca-edc72b3330ab tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:43.584410 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5be44d11-8069-46f1-98ca-edc72b3330ab tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:43.584852 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5be44d11-8069-46f1-98ca-edc72b3330ab tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:43.585608 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5be44d11-8069-46f1-98ca-edc72b3330ab tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:43.586036 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5be44d11-8069-46f1-98ca-edc72b3330ab tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:43.645559 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5be44d11-8069-46f1-98ca-edc72b3330ab tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 29000 microversion: 2.1 time: 0.072475 Jul 19 09:43:43.646152 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 847/1722] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:43 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 29000 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 09:43:44.069451 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bc6ceea0-9daf-4589-b496-1fee3985d314 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:44.070043 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bc6ceea0-9daf-4589-b496-1fee3985d314 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:44.075918 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bc6ceea0-9daf-4589-b496-1fee3985d314 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:44.076372 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bc6ceea0-9daf-4589-b496-1fee3985d314 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:44.077138 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bc6ceea0-9daf-4589-b496-1fee3985d314 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:44.077573 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bc6ceea0-9daf-4589-b496-1fee3985d314 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:44.136017 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bc6ceea0-9daf-4589-b496-1fee3985d314 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:44.143574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bc6ceea0-9daf-4589-b496-1fee3985d314 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.077800 Jul 19 09:43:44.144138 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 876/1723] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:44 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:44.657539 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3304c4ef-ac5c-41e0-bde3-95f950a86b4f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:44.658531 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3304c4ef-ac5c-41e0-bde3-95f950a86b4f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:44.665305 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3304c4ef-ac5c-41e0-bde3-95f950a86b4f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:44.665751 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3304c4ef-ac5c-41e0-bde3-95f950a86b4f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:44.666516 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3304c4ef-ac5c-41e0-bde3-95f950a86b4f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:44.666956 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3304c4ef-ac5c-41e0-bde3-95f950a86b4f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:44.728671 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3304c4ef-ac5c-41e0-bde3-95f950a86b4f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 31206 microversion: 2.1 time: 0.075033 Jul 19 09:43:44.729334 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 848/1724] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:44 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 31206 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:45.160432 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2647122c-4aa2-4d4d-bd70-a9501483b51d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:45.161541 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2647122c-4aa2-4d4d-bd70-a9501483b51d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:45.167655 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2647122c-4aa2-4d4d-bd70-a9501483b51d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:45.168131 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2647122c-4aa2-4d4d-bd70-a9501483b51d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:45.168885 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2647122c-4aa2-4d4d-bd70-a9501483b51d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:45.169312 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2647122c-4aa2-4d4d-bd70-a9501483b51d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:45.229056 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2647122c-4aa2-4d4d-bd70-a9501483b51d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:45.236909 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2647122c-4aa2-4d4d-bd70-a9501483b51d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.080135 Jul 19 09:43:45.237477 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 877/1725] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:45 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:45.740784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7941771b-a68b-45d7-8624-f452bc3f70f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:45.741785 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7941771b-a68b-45d7-8624-f452bc3f70f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:45.748159 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7941771b-a68b-45d7-8624-f452bc3f70f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:45.748612 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7941771b-a68b-45d7-8624-f452bc3f70f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:45.749383 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7941771b-a68b-45d7-8624-f452bc3f70f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:45.749820 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7941771b-a68b-45d7-8624-f452bc3f70f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:45.814991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7941771b-a68b-45d7-8624-f452bc3f70f1 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 32969 microversion: 2.1 time: 0.078223 Jul 19 09:43:45.815998 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 849/1726] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:45 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 32969 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:46.253770 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-002870aa-f8e1-4c7f-94c4-fdf1ee796948 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:46.254318 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-002870aa-f8e1-4c7f-94c4-fdf1ee796948 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:46.260805 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-002870aa-f8e1-4c7f-94c4-fdf1ee796948 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:46.261255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-002870aa-f8e1-4c7f-94c4-fdf1ee796948 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:46.262016 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-002870aa-f8e1-4c7f-94c4-fdf1ee796948 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:46.262450 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-002870aa-f8e1-4c7f-94c4-fdf1ee796948 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:46.324041 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-002870aa-f8e1-4c7f-94c4-fdf1ee796948 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:46.331626 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-002870aa-f8e1-4c7f-94c4-fdf1ee796948 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.081592 Jul 19 09:43:46.332192 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 878/1727] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:46 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:46.832560 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-43141a2f-d8a5-4d1c-b05e-268aed930568 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:46.833540 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-43141a2f-d8a5-4d1c-b05e-268aed930568 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:46.839621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-43141a2f-d8a5-4d1c-b05e-268aed930568 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:46.840069 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-43141a2f-d8a5-4d1c-b05e-268aed930568 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:46.840828 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-43141a2f-d8a5-4d1c-b05e-268aed930568 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:46.841269 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-43141a2f-d8a5-4d1c-b05e-268aed930568 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:46.904721 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-43141a2f-d8a5-4d1c-b05e-268aed930568 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 34009 microversion: 2.1 time: 0.080982 Jul 19 09:43:46.905342 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 850/1728] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:46 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 34009 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:47.347987 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-94ff6534-f356-4034-8e1e-976faa52ae66 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:47.348550 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-94ff6534-f356-4034-8e1e-976faa52ae66 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:47.354337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-94ff6534-f356-4034-8e1e-976faa52ae66 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:47.354779 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-94ff6534-f356-4034-8e1e-976faa52ae66 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:47.355571 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-94ff6534-f356-4034-8e1e-976faa52ae66 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:47.356000 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-94ff6534-f356-4034-8e1e-976faa52ae66 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:47.414579 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-94ff6534-f356-4034-8e1e-976faa52ae66 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:47.422302 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-94ff6534-f356-4034-8e1e-976faa52ae66 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078108 Jul 19 09:43:47.422861 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 879/1729] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:47 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:47.917182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-46734361-b085-4598-9059-3d5e2d518dd4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:47.918242 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-46734361-b085-4598-9059-3d5e2d518dd4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:47.924612 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-46734361-b085-4598-9059-3d5e2d518dd4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:47.925062 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-46734361-b085-4598-9059-3d5e2d518dd4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:47.925821 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-46734361-b085-4598-9059-3d5e2d518dd4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:47.926257 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-46734361-b085-4598-9059-3d5e2d518dd4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:47.991151 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-46734361-b085-4598-9059-3d5e2d518dd4 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 35169 microversion: 2.1 time: 0.077011 Jul 19 09:43:47.991151 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 851/1730] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:47 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 35169 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:48.438443 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2be26d78-95e4-4b14-9a1d-1f5c0cbd0eea tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:48.439067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2be26d78-95e4-4b14-9a1d-1f5c0cbd0eea tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:48.444786 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2be26d78-95e4-4b14-9a1d-1f5c0cbd0eea tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:48.445228 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2be26d78-95e4-4b14-9a1d-1f5c0cbd0eea tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:48.445975 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2be26d78-95e4-4b14-9a1d-1f5c0cbd0eea tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:48.446401 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2be26d78-95e4-4b14-9a1d-1f5c0cbd0eea tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:48.505156 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2be26d78-95e4-4b14-9a1d-1f5c0cbd0eea tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:48.512671 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2be26d78-95e4-4b14-9a1d-1f5c0cbd0eea tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.077865 Jul 19 09:43:48.513223 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 880/1731] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:48 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:49.002148 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-81a5c59d-4139-47d6-8e7a-23868de0970e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:49.003165 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-81a5c59d-4139-47d6-8e7a-23868de0970e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:49.010035 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-81a5c59d-4139-47d6-8e7a-23868de0970e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:49.010482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-81a5c59d-4139-47d6-8e7a-23868de0970e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:49.011269 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-81a5c59d-4139-47d6-8e7a-23868de0970e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:49.011707 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-81a5c59d-4139-47d6-8e7a-23868de0970e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:49.071513 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-81a5c59d-4139-47d6-8e7a-23868de0970e tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 36623 microversion: 2.1 time: 0.073206 Jul 19 09:43:49.076012 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 852/1732] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:48 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 36623 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:49.528717 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-aadec531-cc5d-449a-bc86-28214cf0cc73 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:49.529319 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-aadec531-cc5d-449a-bc86-28214cf0cc73 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:49.535098 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aadec531-cc5d-449a-bc86-28214cf0cc73 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:49.535548 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aadec531-cc5d-449a-bc86-28214cf0cc73 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:49.536297 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aadec531-cc5d-449a-bc86-28214cf0cc73 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:49.536725 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aadec531-cc5d-449a-bc86-28214cf0cc73 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:49.595122 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-aadec531-cc5d-449a-bc86-28214cf0cc73 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:49.602960 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-aadec531-cc5d-449a-bc86-28214cf0cc73 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.077884 Jul 19 09:43:49.603537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 881/1733] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:49 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:50.084645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-65b820e4-a70a-470e-a504-728ef686b77f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:50.085807 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-65b820e4-a70a-470e-a504-728ef686b77f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:50.092589 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-65b820e4-a70a-470e-a504-728ef686b77f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:50.093044 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-65b820e4-a70a-470e-a504-728ef686b77f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:50.093819 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-65b820e4-a70a-470e-a504-728ef686b77f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:50.094254 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-65b820e4-a70a-470e-a504-728ef686b77f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:50.157029 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-65b820e4-a70a-470e-a504-728ef686b77f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 38139 microversion: 2.1 time: 0.076769 Jul 19 09:43:50.161526 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 853/1734] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:50 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 38139 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:50.619720 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-fd41e15e-e915-4bfb-9540-2d373ffc311f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:50.620324 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-fd41e15e-e915-4bfb-9540-2d373ffc311f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:50.626051 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fd41e15e-e915-4bfb-9540-2d373ffc311f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:50.626491 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fd41e15e-e915-4bfb-9540-2d373ffc311f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:50.627268 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fd41e15e-e915-4bfb-9540-2d373ffc311f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:50.627698 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fd41e15e-e915-4bfb-9540-2d373ffc311f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:50.689275 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-fd41e15e-e915-4bfb-9540-2d373ffc311f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:50.697404 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-fd41e15e-e915-4bfb-9540-2d373ffc311f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.081441 Jul 19 09:43:50.697953 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 882/1735] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:50 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:51.169280 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2033209a-4f54-470d-b110-56274ad2f655 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:51.170266 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2033209a-4f54-470d-b110-56274ad2f655 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:51.176562 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2033209a-4f54-470d-b110-56274ad2f655 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:51.177006 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2033209a-4f54-470d-b110-56274ad2f655 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:51.177888 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2033209a-4f54-470d-b110-56274ad2f655 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:51.178220 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2033209a-4f54-470d-b110-56274ad2f655 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:51.241966 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2033209a-4f54-470d-b110-56274ad2f655 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 38167 microversion: 2.1 time: 0.076789 Jul 19 09:43:51.242972 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 854/1736] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:51 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 38167 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:51.713431 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-55f69a2c-52be-4773-98f8-a7fc66e11063 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:51.714037 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-55f69a2c-52be-4773-98f8-a7fc66e11063 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:51.719684 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-55f69a2c-52be-4773-98f8-a7fc66e11063 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:51.720134 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-55f69a2c-52be-4773-98f8-a7fc66e11063 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:51.720887 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-55f69a2c-52be-4773-98f8-a7fc66e11063 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:51.721323 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-55f69a2c-52be-4773-98f8-a7fc66e11063 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:51.780309 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-55f69a2c-52be-4773-98f8-a7fc66e11063 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:51.788392 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-55f69a2c-52be-4773-98f8-a7fc66e11063 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078558 Jul 19 09:43:51.788949 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 883/1737] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:51 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:52.254247 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f75005d5-0536-4642-9ab9-6e562a8128c7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:52.255480 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f75005d5-0536-4642-9ab9-6e562a8128c7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:52.262094 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f75005d5-0536-4642-9ab9-6e562a8128c7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:52.262550 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f75005d5-0536-4642-9ab9-6e562a8128c7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:52.263348 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f75005d5-0536-4642-9ab9-6e562a8128c7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:52.263790 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f75005d5-0536-4642-9ab9-6e562a8128c7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:52.326040 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f75005d5-0536-4642-9ab9-6e562a8128c7 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 38167 microversion: 2.1 time: 0.075919 Jul 19 09:43:52.326905 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 855/1738] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:52 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 38167 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:52.804855 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d542c885-8dc9-4921-bd3c-6fa6f6ee5a02 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:52.805428 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d542c885-8dc9-4921-bd3c-6fa6f6ee5a02 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:52.811130 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d542c885-8dc9-4921-bd3c-6fa6f6ee5a02 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:52.811576 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d542c885-8dc9-4921-bd3c-6fa6f6ee5a02 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:52.812322 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d542c885-8dc9-4921-bd3c-6fa6f6ee5a02 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:52.812749 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d542c885-8dc9-4921-bd3c-6fa6f6ee5a02 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:52.872154 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d542c885-8dc9-4921-bd3c-6fa6f6ee5a02 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:52.879520 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d542c885-8dc9-4921-bd3c-6fa6f6ee5a02 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078397 Jul 19 09:43:52.880069 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 884/1739] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:52 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:53.337941 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fa1afce9-9f33-41da-bde8-3f5e4e90fdfd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:53.339003 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-fa1afce9-9f33-41da-bde8-3f5e4e90fdfd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:53.345658 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa1afce9-9f33-41da-bde8-3f5e4e90fdfd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:53.346104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa1afce9-9f33-41da-bde8-3f5e4e90fdfd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:53.346860 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa1afce9-9f33-41da-bde8-3f5e4e90fdfd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:53.347315 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-fa1afce9-9f33-41da-bde8-3f5e4e90fdfd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:53.411124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fa1afce9-9f33-41da-bde8-3f5e4e90fdfd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 38167 microversion: 2.1 time: 0.077006 Jul 19 09:43:53.412324 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 856/1740] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:53 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 38167 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:53.895841 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4f958df8-e3e2-486f-8c9b-4dbd743092aa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:53.896939 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4f958df8-e3e2-486f-8c9b-4dbd743092aa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:53.902679 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4f958df8-e3e2-486f-8c9b-4dbd743092aa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:53.903146 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4f958df8-e3e2-486f-8c9b-4dbd743092aa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:53.903894 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4f958df8-e3e2-486f-8c9b-4dbd743092aa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:53.904319 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4f958df8-e3e2-486f-8c9b-4dbd743092aa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:53.963382 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4f958df8-e3e2-486f-8c9b-4dbd743092aa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:53.970913 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4f958df8-e3e2-486f-8c9b-4dbd743092aa tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078700 Jul 19 09:43:53.971505 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 885/1741] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:53 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:54.226693 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:43:54.226859 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:43:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:43:54.424124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-78da2f59-3b8a-46cd-bcc4-f0a6da571335 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:43:54.425123 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-78da2f59-3b8a-46cd-bcc4-f0a6da571335 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:54.432014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-78da2f59-3b8a-46cd-bcc4-f0a6da571335 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:54.432465 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-78da2f59-3b8a-46cd-bcc4-f0a6da571335 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:54.433236 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-78da2f59-3b8a-46cd-bcc4-f0a6da571335 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:54.433672 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-78da2f59-3b8a-46cd-bcc4-f0a6da571335 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:54.494877 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-78da2f59-3b8a-46cd-bcc4-f0a6da571335 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action" status: 200 len: 38294 microversion: 2.1 time: 0.074633 Jul 19 09:43:54.495531 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 857/1742] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 09:43:54 2021] POST /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/action => generated 38294 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 09:43:54.505059 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-54b90e45-ff62-4172-807f-203b3bcbed5b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:54.505685 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-54b90e45-ff62-4172-807f-203b3bcbed5b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:54.511944 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-54b90e45-ff62-4172-807f-203b3bcbed5b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:54.512392 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-54b90e45-ff62-4172-807f-203b3bcbed5b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:54.513146 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-54b90e45-ff62-4172-807f-203b3bcbed5b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:54.513575 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-54b90e45-ff62-4172-807f-203b3bcbed5b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:54.535988 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-54b90e45-ff62-4172-807f-203b3bcbed5b tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/ips" status: 200 len: 147 microversion: 2.1 time: 0.034515 Jul 19 09:43:54.536543 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 886/1743] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Jul 19 09:43:54 2021] GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca/ips => generated 147 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:43:54.988411 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f156cf28-26b7-4fb7-9861-4a2cac0f9110 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:54.989016 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f156cf28-26b7-4fb7-9861-4a2cac0f9110 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:54.995926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f156cf28-26b7-4fb7-9861-4a2cac0f9110 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:54.996368 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f156cf28-26b7-4fb7-9861-4a2cac0f9110 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:54.997121 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f156cf28-26b7-4fb7-9861-4a2cac0f9110 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:54.997547 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f156cf28-26b7-4fb7-9861-4a2cac0f9110 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:55.057594 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f156cf28-26b7-4fb7-9861-4a2cac0f9110 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:55.065077 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f156cf28-26b7-4fb7-9861-4a2cac0f9110 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.080819 Jul 19 09:43:55.065631 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 858/1744] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:54 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:56.081296 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-86559d61-1053-466d-838c-040a5f8e4951 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:56.081868 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-86559d61-1053-466d-838c-040a5f8e4951 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:56.087636 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-86559d61-1053-466d-838c-040a5f8e4951 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:56.088088 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-86559d61-1053-466d-838c-040a5f8e4951 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:56.088844 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-86559d61-1053-466d-838c-040a5f8e4951 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:56.089307 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-86559d61-1053-466d-838c-040a5f8e4951 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:56.150455 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-86559d61-1053-466d-838c-040a5f8e4951 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:56.158156 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-86559d61-1053-466d-838c-040a5f8e4951 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.080582 Jul 19 09:43:56.158713 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 887/1745] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:56 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:57.174650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-eb4913e2-af3e-4168-84c3-c057dd8b6bbd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:57.175277 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-eb4913e2-af3e-4168-84c3-c057dd8b6bbd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:57.181484 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eb4913e2-af3e-4168-84c3-c057dd8b6bbd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:57.181921 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eb4913e2-af3e-4168-84c3-c057dd8b6bbd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:57.182688 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eb4913e2-af3e-4168-84c3-c057dd8b6bbd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:57.183124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-eb4913e2-af3e-4168-84c3-c057dd8b6bbd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:57.242595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-eb4913e2-af3e-4168-84c3-c057dd8b6bbd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:57.250242 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-eb4913e2-af3e-4168-84c3-c057dd8b6bbd tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079288 Jul 19 09:43:57.250797 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 859/1746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:57 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:58.266304 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d2f17079-5769-4881-8ee0-2b88d5a21497 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:58.266906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d2f17079-5769-4881-8ee0-2b88d5a21497 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:58.273096 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d2f17079-5769-4881-8ee0-2b88d5a21497 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:58.273536 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d2f17079-5769-4881-8ee0-2b88d5a21497 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:58.274288 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d2f17079-5769-4881-8ee0-2b88d5a21497 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:58.274716 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d2f17079-5769-4881-8ee0-2b88d5a21497 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:58.332813 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d2f17079-5769-4881-8ee0-2b88d5a21497 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:58.340702 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d2f17079-5769-4881-8ee0-2b88d5a21497 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078133 Jul 19 09:43:58.341258 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 888/1747] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:58 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:43:59.357898 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f6048608-2e7d-440b-88d5-b45c40077fad tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:43:59.358428 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f6048608-2e7d-440b-88d5-b45c40077fad tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:43:59.365533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f6048608-2e7d-440b-88d5-b45c40077fad tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:59.365980 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f6048608-2e7d-440b-88d5-b45c40077fad tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:59.366729 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f6048608-2e7d-440b-88d5-b45c40077fad tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:43:59.367193 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f6048608-2e7d-440b-88d5-b45c40077fad tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:43:59.688230 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f6048608-2e7d-440b-88d5-b45c40077fad tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:43:59.696180 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f6048608-2e7d-440b-88d5-b45c40077fad tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.342225 Jul 19 09:43:59.696739 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 860/1748] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:43:59 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:00.712219 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-41d08d74-5da5-4841-80dc-3594c919fa97 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:00.712819 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-41d08d74-5da5-4841-80dc-3594c919fa97 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:00.718497 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-41d08d74-5da5-4841-80dc-3594c919fa97 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:00.718942 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-41d08d74-5da5-4841-80dc-3594c919fa97 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:00.719738 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-41d08d74-5da5-4841-80dc-3594c919fa97 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:00.720169 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-41d08d74-5da5-4841-80dc-3594c919fa97 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:00.779974 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-41d08d74-5da5-4841-80dc-3594c919fa97 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:00.788211 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-41d08d74-5da5-4841-80dc-3594c919fa97 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079588 Jul 19 09:44:00.788769 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 889/1749] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:00 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:01.804454 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-70f9a14a-8471-4ae6-b803-9e8278964759 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:01.805055 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-70f9a14a-8471-4ae6-b803-9e8278964759 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:01.811857 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70f9a14a-8471-4ae6-b803-9e8278964759 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:01.812383 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70f9a14a-8471-4ae6-b803-9e8278964759 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:01.813257 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70f9a14a-8471-4ae6-b803-9e8278964759 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:01.813757 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70f9a14a-8471-4ae6-b803-9e8278964759 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:01.873336 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-70f9a14a-8471-4ae6-b803-9e8278964759 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:01.881301 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-70f9a14a-8471-4ae6-b803-9e8278964759 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079895 Jul 19 09:44:01.881848 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 861/1750] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:01 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:02.897945 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-aabfc606-5d47-47af-8e53-5cb822203c0f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:02.898545 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-aabfc606-5d47-47af-8e53-5cb822203c0f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:02.904247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aabfc606-5d47-47af-8e53-5cb822203c0f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:02.904689 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aabfc606-5d47-47af-8e53-5cb822203c0f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:02.905435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aabfc606-5d47-47af-8e53-5cb822203c0f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:02.905864 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-aabfc606-5d47-47af-8e53-5cb822203c0f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:02.964475 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-aabfc606-5d47-47af-8e53-5cb822203c0f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:02.971811 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-aabfc606-5d47-47af-8e53-5cb822203c0f tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078034 Jul 19 09:44:02.972368 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 890/1751] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:02 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:03.988744 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-11746725-b37d-445e-af3c-efa69f352bfc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:03.989356 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-11746725-b37d-445e-af3c-efa69f352bfc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:03.996105 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-11746725-b37d-445e-af3c-efa69f352bfc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:03.996545 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-11746725-b37d-445e-af3c-efa69f352bfc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:03.997307 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-11746725-b37d-445e-af3c-efa69f352bfc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:03.997739 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-11746725-b37d-445e-af3c-efa69f352bfc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:04.057695 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-11746725-b37d-445e-af3c-efa69f352bfc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:04.065149 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-11746725-b37d-445e-af3c-efa69f352bfc tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.080138 Jul 19 09:44:04.065707 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 862/1752] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:03 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:05.081515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4757123e-18a4-4669-acfd-ed1deede7152 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:05.082053 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4757123e-18a4-4669-acfd-ed1deede7152 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:05.087835 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4757123e-18a4-4669-acfd-ed1deede7152 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:05.088286 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4757123e-18a4-4669-acfd-ed1deede7152 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:05.089045 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4757123e-18a4-4669-acfd-ed1deede7152 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:05.089475 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4757123e-18a4-4669-acfd-ed1deede7152 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:05.151469 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4757123e-18a4-4669-acfd-ed1deede7152 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:05.159078 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4757123e-18a4-4669-acfd-ed1deede7152 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.081295 Jul 19 09:44:05.159637 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 891/1753] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:05 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:06.175563 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1cabcbfe-b5ee-4c28-8960-2899d75de45b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:06.176163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1cabcbfe-b5ee-4c28-8960-2899d75de45b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:06.181883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1cabcbfe-b5ee-4c28-8960-2899d75de45b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:06.182329 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1cabcbfe-b5ee-4c28-8960-2899d75de45b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:06.183102 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1cabcbfe-b5ee-4c28-8960-2899d75de45b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:06.183540 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1cabcbfe-b5ee-4c28-8960-2899d75de45b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:06.244770 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1cabcbfe-b5ee-4c28-8960-2899d75de45b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:06.252182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1cabcbfe-b5ee-4c28-8960-2899d75de45b tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.080270 Jul 19 09:44:06.252734 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 863/1754] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:06 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:07.269099 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ca0f5962-4bf9-453f-a7ed-76a864ed0f69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:07.269732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ca0f5962-4bf9-453f-a7ed-76a864ed0f69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:07.275427 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ca0f5962-4bf9-453f-a7ed-76a864ed0f69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:07.275873 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ca0f5962-4bf9-453f-a7ed-76a864ed0f69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:07.276629 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ca0f5962-4bf9-453f-a7ed-76a864ed0f69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:07.277057 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ca0f5962-4bf9-453f-a7ed-76a864ed0f69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:07.336201 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ca0f5962-4bf9-453f-a7ed-76a864ed0f69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:07.343876 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ca0f5962-4bf9-453f-a7ed-76a864ed0f69 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078478 Jul 19 09:44:07.344437 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 892/1755] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:07 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:08.360250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7199ee53-2a3d-47b7-ba63-24082ff50db4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:08.360805 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7199ee53-2a3d-47b7-ba63-24082ff50db4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:08.366493 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7199ee53-2a3d-47b7-ba63-24082ff50db4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:08.366934 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7199ee53-2a3d-47b7-ba63-24082ff50db4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:08.367716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7199ee53-2a3d-47b7-ba63-24082ff50db4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:08.368144 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7199ee53-2a3d-47b7-ba63-24082ff50db4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:08.577323 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7199ee53-2a3d-47b7-ba63-24082ff50db4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:08.585508 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7199ee53-2a3d-47b7-ba63-24082ff50db4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.228963 Jul 19 09:44:08.586098 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 864/1756] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:08 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:09.601695 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-827c2616-bbb3-4b45-855c-4c0a4934e336 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:09.602298 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-827c2616-bbb3-4b45-855c-4c0a4934e336 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:09.608239 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-827c2616-bbb3-4b45-855c-4c0a4934e336 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:09.608690 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-827c2616-bbb3-4b45-855c-4c0a4934e336 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:09.609449 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-827c2616-bbb3-4b45-855c-4c0a4934e336 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:09.609885 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-827c2616-bbb3-4b45-855c-4c0a4934e336 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:09.669722 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-827c2616-bbb3-4b45-855c-4c0a4934e336 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:09.677744 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-827c2616-bbb3-4b45-855c-4c0a4934e336 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079100 Jul 19 09:44:09.678294 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 893/1757] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:09 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:10.694863 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-67bd4ee3-35af-416b-88c3-18197b24112d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:10.695488 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-67bd4ee3-35af-416b-88c3-18197b24112d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:10.701172 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-67bd4ee3-35af-416b-88c3-18197b24112d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:10.701612 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-67bd4ee3-35af-416b-88c3-18197b24112d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:10.702368 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-67bd4ee3-35af-416b-88c3-18197b24112d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:10.702793 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-67bd4ee3-35af-416b-88c3-18197b24112d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:10.761804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-67bd4ee3-35af-416b-88c3-18197b24112d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:10.770024 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-67bd4ee3-35af-416b-88c3-18197b24112d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079314 Jul 19 09:44:10.770699 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 865/1758] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:10 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:11.788124 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-da5ee130-5066-4d9f-9591-9f3fcde1a623 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:11.788726 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-da5ee130-5066-4d9f-9591-9f3fcde1a623 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:11.794844 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da5ee130-5066-4d9f-9591-9f3fcde1a623 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:11.795329 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da5ee130-5066-4d9f-9591-9f3fcde1a623 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:11.796087 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da5ee130-5066-4d9f-9591-9f3fcde1a623 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:11.796520 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-da5ee130-5066-4d9f-9591-9f3fcde1a623 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:11.854777 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-da5ee130-5066-4d9f-9591-9f3fcde1a623 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:11.862336 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-da5ee130-5066-4d9f-9591-9f3fcde1a623 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078434 Jul 19 09:44:11.862895 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 894/1759] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:11 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:12.878570 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1014b06f-d114-4e6c-aee4-cbc1a8e23f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:12.879173 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1014b06f-d114-4e6c-aee4-cbc1a8e23f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:12.885366 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1014b06f-d114-4e6c-aee4-cbc1a8e23f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:12.885825 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1014b06f-d114-4e6c-aee4-cbc1a8e23f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:12.886578 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1014b06f-d114-4e6c-aee4-cbc1a8e23f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:12.887007 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1014b06f-d114-4e6c-aee4-cbc1a8e23f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:12.946277 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1014b06f-d114-4e6c-aee4-cbc1a8e23f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:12.954078 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1014b06f-d114-4e6c-aee4-cbc1a8e23f84 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079207 Jul 19 09:44:12.954635 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 866/1760] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:12 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:13.970221 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e8947648-00e7-45af-9e95-49d7af4afd25 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:13.970854 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e8947648-00e7-45af-9e95-49d7af4afd25 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:13.976547 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e8947648-00e7-45af-9e95-49d7af4afd25 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:13.976998 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e8947648-00e7-45af-9e95-49d7af4afd25 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:13.977756 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e8947648-00e7-45af-9e95-49d7af4afd25 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:13.978187 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e8947648-00e7-45af-9e95-49d7af4afd25 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:14.039706 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e8947648-00e7-45af-9e95-49d7af4afd25 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:14.047479 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e8947648-00e7-45af-9e95-49d7af4afd25 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.080910 Jul 19 09:44:14.048044 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 895/1761] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:13 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:15.064264 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6c892155-e4a3-445b-8d2f-7d5c1b1ed237 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:15.064878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6c892155-e4a3-445b-8d2f-7d5c1b1ed237 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:15.071213 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6c892155-e4a3-445b-8d2f-7d5c1b1ed237 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:15.071663 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6c892155-e4a3-445b-8d2f-7d5c1b1ed237 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:15.072435 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6c892155-e4a3-445b-8d2f-7d5c1b1ed237 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:15.072872 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6c892155-e4a3-445b-8d2f-7d5c1b1ed237 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:15.132068 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6c892155-e4a3-445b-8d2f-7d5c1b1ed237 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:15.139606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6c892155-e4a3-445b-8d2f-7d5c1b1ed237 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079041 Jul 19 09:44:15.140168 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 867/1762] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:15 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:16.156537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-416dbf80-d90d-490b-8701-2f9f8db27211 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:16.157233 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-416dbf80-d90d-490b-8701-2f9f8db27211 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:16.163703 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-416dbf80-d90d-490b-8701-2f9f8db27211 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:16.164153 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-416dbf80-d90d-490b-8701-2f9f8db27211 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:16.164910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-416dbf80-d90d-490b-8701-2f9f8db27211 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:16.165591 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-416dbf80-d90d-490b-8701-2f9f8db27211 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:16.225947 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-416dbf80-d90d-490b-8701-2f9f8db27211 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:16.233524 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-416dbf80-d90d-490b-8701-2f9f8db27211 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.080657 Jul 19 09:44:16.234091 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 896/1763] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:16 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:17.249691 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-10e483b0-f122-4d0f-9fb2-f7a1693ad8b6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:17.250298 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-10e483b0-f122-4d0f-9fb2-f7a1693ad8b6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:17.256004 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-10e483b0-f122-4d0f-9fb2-f7a1693ad8b6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:17.256453 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-10e483b0-f122-4d0f-9fb2-f7a1693ad8b6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:17.257209 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-10e483b0-f122-4d0f-9fb2-f7a1693ad8b6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:17.257638 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-10e483b0-f122-4d0f-9fb2-f7a1693ad8b6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:17.321739 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-10e483b0-f122-4d0f-9fb2-f7a1693ad8b6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:17.329580 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-10e483b0-f122-4d0f-9fb2-f7a1693ad8b6 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.083517 Jul 19 09:44:17.330127 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 868/1764] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:17 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:18.345740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8d618006-d92e-44e8-8677-13d3f0d87008 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:18.346332 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8d618006-d92e-44e8-8677-13d3f0d87008 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:18.352121 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d618006-d92e-44e8-8677-13d3f0d87008 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:18.352565 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d618006-d92e-44e8-8677-13d3f0d87008 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:18.353313 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d618006-d92e-44e8-8677-13d3f0d87008 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:18.353741 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d618006-d92e-44e8-8677-13d3f0d87008 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:18.412417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8d618006-d92e-44e8-8677-13d3f0d87008 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:18.420202 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8d618006-d92e-44e8-8677-13d3f0d87008 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.078029 Jul 19 09:44:18.420688 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 897/1765] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:18 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:19.436875 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f35a5de7-e1b9-41a5-b694-a9d779d723de tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:19.437414 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f35a5de7-e1b9-41a5-b694-a9d779d723de tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:19.443277 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f35a5de7-e1b9-41a5-b694-a9d779d723de tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:19.443721 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f35a5de7-e1b9-41a5-b694-a9d779d723de tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:19.444468 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f35a5de7-e1b9-41a5-b694-a9d779d723de tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:19.444897 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f35a5de7-e1b9-41a5-b694-a9d779d723de tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:19.504380 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f35a5de7-e1b9-41a5-b694-a9d779d723de tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:44:19.512600 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f35a5de7-e1b9-41a5-b694-a9d779d723de tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 200 len: 1347 microversion: 2.1 time: 0.079453 Jul 19 09:44:19.513151 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 869/1766] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:19 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 1347 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:44:20.530118 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cdd3f8c8-b46d-442a-afce-74576f971148 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:44:20.530734 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-cdd3f8c8-b46d-442a-afce-74576f971148 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: a5684c14-21c0-4aeb-9ca6-9df7ae3111f8] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:44:20.537200 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdd3f8c8-b46d-442a-afce-74576f971148 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:20.537644 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdd3f8c8-b46d-442a-afce-74576f971148 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:20.538405 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdd3f8c8-b46d-442a-afce-74576f971148 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:44:20.538833 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cdd3f8c8-b46d-442a-afce-74576f971148 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:44:20.553448 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-cdd3f8c8-b46d-442a-afce-74576f971148 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] HTTP exception thrown: Instance a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 could not be found. Jul 19 09:44:20.554043 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cdd3f8c8-b46d-442a-afce-74576f971148 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Returning 404 to user: Instance a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:44:20.554865 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-cdd3f8c8-b46d-442a-afce-74576f971148 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8" status: 404 len: 111 microversion: 2.1 time: 0.028753 Jul 19 09:44:20.555662 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 898/1767] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:44:20 2021] GET /compute/v2.1/servers/a5684c14-21c0-4aeb-9ca6-9df7ae3111f8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:45:32.845870 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:45:32.846484 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:45:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:45:37.220557 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:45:37.221166 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:45:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:46:36.071205 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 09:46:36.074981 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-42eee6fb-7dc0-4c9a-8f28-2949d410f568 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:36.075505 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-42eee6fb-7dc0-4c9a-8f28-2949d410f568 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:36.081341 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-42eee6fb-7dc0-4c9a-8f28-2949d410f568 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:36.081792 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-42eee6fb-7dc0-4c9a-8f28-2949d410f568 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:36.082551 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-42eee6fb-7dc0-4c9a-8f28-2949d410f568 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:36.082992 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-42eee6fb-7dc0-4c9a-8f28-2949d410f568 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:36.108080 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-42eee6fb-7dc0-4c9a-8f28-2949d410f568 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Going to try to terminate instance {{(pid=107464) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:46:36.178955 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-42eee6fb-7dc0-4c9a-8f28-2949d410f568 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 204 len: 0 microversion: 2.1 time: 0.109492 Jul 19 09:46:36.179594 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 870/1768] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:46:36 2021] DELETE /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 09:46:36.185740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 19 09:46:36.189784 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0825b385-0021-46c7-bb02-37f0e67e3a66 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:36.190380 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0825b385-0021-46c7-bb02-37f0e67e3a66 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:36.196177 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0825b385-0021-46c7-bb02-37f0e67e3a66 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:36.196620 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0825b385-0021-46c7-bb02-37f0e67e3a66 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:36.197444 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0825b385-0021-46c7-bb02-37f0e67e3a66 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:36.197870 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0825b385-0021-46c7-bb02-37f0e67e3a66 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:36.382712 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0825b385-0021-46c7-bb02-37f0e67e3a66 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:36.389975 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0825b385-0021-46c7-bb02-37f0e67e3a66 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1509 microversion: 2.1 time: 0.205687 Jul 19 09:46:36.390532 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 899/1769] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:36 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:37.132191 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33340. Jul 19 09:46:37.173556 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-8bc7e615-8db4-408e-82ee-2b59795d50f8 req-762b5d13-9a76-4b21-990b-6b6b3b914058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfba731a-5973-464c-b66a-ab861a0faa9a", "name": "network-vif-deleted", "tag": "cd6668d4-42a5-43df-930c-788339f4d15f"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:46:37.175020 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:46:37.175020 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:46:37.183637 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-8bc7e615-8db4-408e-82ee-2b59795d50f8 req-762b5d13-9a76-4b21-990b-6b6b3b914058 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:37.184091 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-8bc7e615-8db4-408e-82ee-2b59795d50f8 req-762b5d13-9a76-4b21-990b-6b6b3b914058 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:37.194773 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-8bc7e615-8db4-408e-82ee-2b59795d50f8 req-762b5d13-9a76-4b21-990b-6b6b3b914058 service nova] Creating event network-vif-deleted:cd6668d4-42a5-43df-930c-788339f4d15f for instance dfba731a-5973-464c-b66a-ab861a0faa9a on hv-cinder-79338 Jul 19 09:46:37.200053 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-8bc7e615-8db4-408e-82ee-2b59795d50f8 req-762b5d13-9a76-4b21-990b-6b6b3b914058 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109879 Jul 19 09:46:37.200813 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 871/1770] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:46:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:46:37.406306 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-38e04e14-39c8-4255-ad3f-a36f350ffff3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:37.406918 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-38e04e14-39c8-4255-ad3f-a36f350ffff3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:37.425325 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-38e04e14-39c8-4255-ad3f-a36f350ffff3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:37.425885 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-38e04e14-39c8-4255-ad3f-a36f350ffff3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:37.426685 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-38e04e14-39c8-4255-ad3f-a36f350ffff3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:37.427141 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-38e04e14-39c8-4255-ad3f-a36f350ffff3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:37.442965 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33352. Jul 19 09:46:37.459249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-38e04e14-39c8-4255-ad3f-a36f350ffff3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:37.459701 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-38e04e14-39c8-4255-ad3f-a36f350ffff3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:37.460143 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.objects.instance [None req-38e04e14-39c8-4255-ad3f-a36f350ffff3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lazy-loading 'fault' on Instance uuid dfba731a-5973-464c-b66a-ab861a0faa9a {{(pid=107463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:46:37.500696 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-38e04e14-39c8-4255-ad3f-a36f350ffff3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:37.508255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-38e04e14-39c8-4255-ad3f-a36f350ffff3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 200 len: 1312 microversion: 2.1 time: 0.105482 Jul 19 09:46:37.509025 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 900/1771] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:37 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:38.525073 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ffee22bc-c478-48c9-9446-1653f703f1a5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:38.526281 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ffee22bc-c478-48c9-9446-1653f703f1a5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: dfba731a-5973-464c-b66a-ab861a0faa9a] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:38.532218 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ffee22bc-c478-48c9-9446-1653f703f1a5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:38.532653 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ffee22bc-c478-48c9-9446-1653f703f1a5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:38.533409 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ffee22bc-c478-48c9-9446-1653f703f1a5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:38.533839 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ffee22bc-c478-48c9-9446-1653f703f1a5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:38.547412 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-ffee22bc-c478-48c9-9446-1653f703f1a5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] HTTP exception thrown: Instance dfba731a-5973-464c-b66a-ab861a0faa9a could not be found. Jul 19 09:46:38.547920 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ffee22bc-c478-48c9-9446-1653f703f1a5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Returning 404 to user: Instance dfba731a-5973-464c-b66a-ab861a0faa9a could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:46:38.548857 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ffee22bc-c478-48c9-9446-1653f703f1a5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a" status: 404 len: 111 microversion: 2.1 time: 0.027844 Jul 19 09:46:38.549352 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 872/1772] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:38 2021] GET /compute/v2.1/servers/dfba731a-5973-464c-b66a-ab861a0faa9a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:46:38.556976 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9833fee4-f926-4971-8564-ed6b14a315ff tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:38.557487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9833fee4-f926-4971-8564-ed6b14a315ff tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:38.563359 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9833fee4-f926-4971-8564-ed6b14a315ff tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:38.563808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9833fee4-f926-4971-8564-ed6b14a315ff tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:38.564578 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9833fee4-f926-4971-8564-ed6b14a315ff tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:38.565007 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9833fee4-f926-4971-8564-ed6b14a315ff tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:38.589485 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9833fee4-f926-4971-8564-ed6b14a315ff tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Going to try to terminate instance {{(pid=107463) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:46:38.663415 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9833fee4-f926-4971-8564-ed6b14a315ff tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 204 len: 0 microversion: 2.1 time: 0.109839 Jul 19 09:46:38.664083 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 901/1773] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:46:38 2021] DELETE /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 09:46:38.672869 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d4fe74e7-fe66-4b54-8825-e02f26ed7ce3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:38.673470 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d4fe74e7-fe66-4b54-8825-e02f26ed7ce3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:38.679312 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d4fe74e7-fe66-4b54-8825-e02f26ed7ce3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:38.679761 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d4fe74e7-fe66-4b54-8825-e02f26ed7ce3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:38.680510 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d4fe74e7-fe66-4b54-8825-e02f26ed7ce3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:38.680936 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d4fe74e7-fe66-4b54-8825-e02f26ed7ce3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:38.852793 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d4fe74e7-fe66-4b54-8825-e02f26ed7ce3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:38.860392 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d4fe74e7-fe66-4b54-8825-e02f26ed7ce3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1569 microversion: 2.1 time: 0.191287 Jul 19 09:46:38.860947 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 873/1774] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:38 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:39.736673 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-648bdcd7-3001-4c7d-bb6f-763d096b3522 req-9a5980a3-3cd0-4a2d-aad0-0c489456523a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee4430d-0d5f-45bd-848e-aa6f05870b67", "name": "network-vif-deleted", "tag": "660f7d44-fdeb-40bd-b04d-cde195c49525"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:46:39.738304 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:46:39.738304 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:46:39.746144 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-648bdcd7-3001-4c7d-bb6f-763d096b3522 req-9a5980a3-3cd0-4a2d-aad0-0c489456523a service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:39.746594 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-648bdcd7-3001-4c7d-bb6f-763d096b3522 req-9a5980a3-3cd0-4a2d-aad0-0c489456523a service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:39.758468 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-648bdcd7-3001-4c7d-bb6f-763d096b3522 req-9a5980a3-3cd0-4a2d-aad0-0c489456523a service nova] Creating event network-vif-deleted:660f7d44-fdeb-40bd-b04d-cde195c49525 for instance 0ee4430d-0d5f-45bd-848e-aa6f05870b67 on hv-cinder-79338 Jul 19 09:46:39.763007 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-648bdcd7-3001-4c7d-bb6f-763d096b3522 req-9a5980a3-3cd0-4a2d-aad0-0c489456523a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030416 Jul 19 09:46:39.763594 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 902/1775] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:46:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:46:39.876798 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5b716080-bf5b-454c-8946-58f1005ca935 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:39.877405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5b716080-bf5b-454c-8946-58f1005ca935 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:39.883130 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5b716080-bf5b-454c-8946-58f1005ca935 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:39.883578 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5b716080-bf5b-454c-8946-58f1005ca935 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:39.884334 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5b716080-bf5b-454c-8946-58f1005ca935 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:39.884796 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5b716080-bf5b-454c-8946-58f1005ca935 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:39.944124 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5b716080-bf5b-454c-8946-58f1005ca935 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:39.951689 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5b716080-bf5b-454c-8946-58f1005ca935 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078498 Jul 19 09:46:39.952244 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 874/1776] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:39 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:40.968530 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d0f5809f-1d0e-4733-a38f-4ce00373e0c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:40.969153 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d0f5809f-1d0e-4733-a38f-4ce00373e0c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:40.975206 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d0f5809f-1d0e-4733-a38f-4ce00373e0c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:40.975662 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d0f5809f-1d0e-4733-a38f-4ce00373e0c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:40.976429 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d0f5809f-1d0e-4733-a38f-4ce00373e0c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:40.976865 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d0f5809f-1d0e-4733-a38f-4ce00373e0c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:41.036832 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d0f5809f-1d0e-4733-a38f-4ce00373e0c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:41.045006 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d0f5809f-1d0e-4733-a38f-4ce00373e0c1 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080597 Jul 19 09:46:41.045565 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 903/1777] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:40 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:46:42.061213 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-61c9c8be-bebc-4041-b1c3-9ed5ec2003bc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:42.061730 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-61c9c8be-bebc-4041-b1c3-9ed5ec2003bc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:42.067455 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-61c9c8be-bebc-4041-b1c3-9ed5ec2003bc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:42.067898 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-61c9c8be-bebc-4041-b1c3-9ed5ec2003bc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:42.068647 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-61c9c8be-bebc-4041-b1c3-9ed5ec2003bc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:42.069076 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-61c9c8be-bebc-4041-b1c3-9ed5ec2003bc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:42.128862 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-61c9c8be-bebc-4041-b1c3-9ed5ec2003bc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:42.136820 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-61c9c8be-bebc-4041-b1c3-9ed5ec2003bc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079319 Jul 19 09:46:42.137379 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 875/1778] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:42 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:43.153282 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e29a5c2f-729d-48a2-b325-46cf563525e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:43.153851 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e29a5c2f-729d-48a2-b325-46cf563525e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:43.159671 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e29a5c2f-729d-48a2-b325-46cf563525e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:43.160121 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e29a5c2f-729d-48a2-b325-46cf563525e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:43.160970 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e29a5c2f-729d-48a2-b325-46cf563525e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:43.161408 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e29a5c2f-729d-48a2-b325-46cf563525e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:43.221428 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e29a5c2f-729d-48a2-b325-46cf563525e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:43.228938 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e29a5c2f-729d-48a2-b325-46cf563525e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079452 Jul 19 09:46:43.229491 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 904/1779] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:43 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:44.245191 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b74012ab-8bc5-4f43-aba1-457102e4f1a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:44.245802 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b74012ab-8bc5-4f43-aba1-457102e4f1a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:44.251631 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b74012ab-8bc5-4f43-aba1-457102e4f1a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:44.252080 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b74012ab-8bc5-4f43-aba1-457102e4f1a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:44.252839 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b74012ab-8bc5-4f43-aba1-457102e4f1a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:44.253273 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b74012ab-8bc5-4f43-aba1-457102e4f1a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:44.315814 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b74012ab-8bc5-4f43-aba1-457102e4f1a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:44.323921 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b74012ab-8bc5-4f43-aba1-457102e4f1a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.082412 Jul 19 09:46:44.324482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 876/1780] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:44 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:45.340842 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-160ede56-2f2a-47e1-a546-52ba3a73272c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:45.341457 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-160ede56-2f2a-47e1-a546-52ba3a73272c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:45.347272 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-160ede56-2f2a-47e1-a546-52ba3a73272c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:45.347724 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-160ede56-2f2a-47e1-a546-52ba3a73272c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:45.348489 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-160ede56-2f2a-47e1-a546-52ba3a73272c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:45.348925 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-160ede56-2f2a-47e1-a546-52ba3a73272c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:45.410248 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-160ede56-2f2a-47e1-a546-52ba3a73272c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:45.418635 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-160ede56-2f2a-47e1-a546-52ba3a73272c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.081914 Jul 19 09:46:45.419164 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 905/1781] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:45 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:46.435840 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-70c85257-383c-4d88-a0bf-7e70f91b779b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:46.436456 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-70c85257-383c-4d88-a0bf-7e70f91b779b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:46.442255 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70c85257-383c-4d88-a0bf-7e70f91b779b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:46.442704 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70c85257-383c-4d88-a0bf-7e70f91b779b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:46.443521 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70c85257-383c-4d88-a0bf-7e70f91b779b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:46.443957 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-70c85257-383c-4d88-a0bf-7e70f91b779b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:46.503476 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-70c85257-383c-4d88-a0bf-7e70f91b779b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:46.511122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-70c85257-383c-4d88-a0bf-7e70f91b779b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079492 Jul 19 09:46:46.511671 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 877/1782] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:46 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:47.527375 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4f8948ec-638d-4a6a-8cb2-3e5f8f98ac6f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:47.527948 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4f8948ec-638d-4a6a-8cb2-3e5f8f98ac6f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:47.533703 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4f8948ec-638d-4a6a-8cb2-3e5f8f98ac6f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:47.534255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4f8948ec-638d-4a6a-8cb2-3e5f8f98ac6f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:47.535021 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4f8948ec-638d-4a6a-8cb2-3e5f8f98ac6f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:47.535470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4f8948ec-638d-4a6a-8cb2-3e5f8f98ac6f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:47.596102 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4f8948ec-638d-4a6a-8cb2-3e5f8f98ac6f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:47.605652 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4f8948ec-638d-4a6a-8cb2-3e5f8f98ac6f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.081948 Jul 19 09:46:47.606247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 906/1783] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:47 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:48.621792 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-010abeb7-2286-4bfe-ac7f-23686ee2b298 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:48.622407 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-010abeb7-2286-4bfe-ac7f-23686ee2b298 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:48.628250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-010abeb7-2286-4bfe-ac7f-23686ee2b298 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:48.628705 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-010abeb7-2286-4bfe-ac7f-23686ee2b298 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:48.629472 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-010abeb7-2286-4bfe-ac7f-23686ee2b298 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:48.629911 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-010abeb7-2286-4bfe-ac7f-23686ee2b298 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:48.690087 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-010abeb7-2286-4bfe-ac7f-23686ee2b298 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:48.698156 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-010abeb7-2286-4bfe-ac7f-23686ee2b298 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079529 Jul 19 09:46:48.698715 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 878/1784] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:48 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:49.714248 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-68589fe7-ee71-459d-aed1-cbdf62bc7db0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:49.714829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-68589fe7-ee71-459d-aed1-cbdf62bc7db0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:49.720627 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-68589fe7-ee71-459d-aed1-cbdf62bc7db0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:49.721071 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-68589fe7-ee71-459d-aed1-cbdf62bc7db0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:49.721821 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-68589fe7-ee71-459d-aed1-cbdf62bc7db0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:49.722250 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-68589fe7-ee71-459d-aed1-cbdf62bc7db0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:49.780580 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-68589fe7-ee71-459d-aed1-cbdf62bc7db0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:49.787955 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-68589fe7-ee71-459d-aed1-cbdf62bc7db0 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.077371 Jul 19 09:46:49.788505 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 907/1785] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:49 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:50.804296 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-0a4bdead-2f22-4a15-89b2-84343aa84967 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:50.804908 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-0a4bdead-2f22-4a15-89b2-84343aa84967 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:50.810789 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0a4bdead-2f22-4a15-89b2-84343aa84967 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:50.811266 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0a4bdead-2f22-4a15-89b2-84343aa84967 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:50.812026 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0a4bdead-2f22-4a15-89b2-84343aa84967 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:50.812462 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-0a4bdead-2f22-4a15-89b2-84343aa84967 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:50.875563 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-0a4bdead-2f22-4a15-89b2-84343aa84967 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:50.883172 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-0a4bdead-2f22-4a15-89b2-84343aa84967 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.082546 Jul 19 09:46:50.883729 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 879/1786] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:50 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:51.899920 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-08389122-cc13-4303-887f-bde45590da3e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:51.900527 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-08389122-cc13-4303-887f-bde45590da3e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:51.906459 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-08389122-cc13-4303-887f-bde45590da3e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:51.906907 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-08389122-cc13-4303-887f-bde45590da3e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:51.907693 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-08389122-cc13-4303-887f-bde45590da3e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:51.908124 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-08389122-cc13-4303-887f-bde45590da3e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:51.967757 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-08389122-cc13-4303-887f-bde45590da3e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:51.975468 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-08389122-cc13-4303-887f-bde45590da3e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079153 Jul 19 09:46:51.976027 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 908/1787] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:51 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:46:52.992248 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f8b08d18-080a-4ae6-98b8-51f90ff07afa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:52.992862 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f8b08d18-080a-4ae6-98b8-51f90ff07afa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:52.999174 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f8b08d18-080a-4ae6-98b8-51f90ff07afa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:52.999630 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f8b08d18-080a-4ae6-98b8-51f90ff07afa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:53.000405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f8b08d18-080a-4ae6-98b8-51f90ff07afa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:53.000843 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f8b08d18-080a-4ae6-98b8-51f90ff07afa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:53.062479 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f8b08d18-080a-4ae6-98b8-51f90ff07afa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:53.070181 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f8b08d18-080a-4ae6-98b8-51f90ff07afa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.081658 Jul 19 09:46:53.070735 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 880/1788] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:52 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:54.086329 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bb1846d6-1aa9-4960-9aa4-79e2504098bd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:54.086920 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bb1846d6-1aa9-4960-9aa4-79e2504098bd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:54.093016 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb1846d6-1aa9-4960-9aa4-79e2504098bd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:54.093529 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb1846d6-1aa9-4960-9aa4-79e2504098bd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:54.094352 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb1846d6-1aa9-4960-9aa4-79e2504098bd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:54.094783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb1846d6-1aa9-4960-9aa4-79e2504098bd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:54.157853 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bb1846d6-1aa9-4960-9aa4-79e2504098bd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:54.171410 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bb1846d6-1aa9-4960-9aa4-79e2504098bd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.087909 Jul 19 09:46:54.172038 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 909/1789] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:54 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:55.187181 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-970c2725-f3ec-447c-82e2-7ed69e0059aa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:55.187789 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-970c2725-f3ec-447c-82e2-7ed69e0059aa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:55.193744 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-970c2725-f3ec-447c-82e2-7ed69e0059aa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:55.194395 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-970c2725-f3ec-447c-82e2-7ed69e0059aa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:55.194940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-970c2725-f3ec-447c-82e2-7ed69e0059aa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:55.195397 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-970c2725-f3ec-447c-82e2-7ed69e0059aa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:55.227183 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:46:55.227370 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:46:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 (ip 10.222.0.16) !!! Jul 19 09:46:55.258606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-970c2725-f3ec-447c-82e2-7ed69e0059aa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:55.266862 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-970c2725-f3ec-447c-82e2-7ed69e0059aa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.083798 Jul 19 09:46:55.267438 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 881/1790] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:55 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:56.283462 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c1e3cde3-2c1c-4959-b2fd-55ac7f9a007e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:56.283988 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c1e3cde3-2c1c-4959-b2fd-55ac7f9a007e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:56.289737 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1e3cde3-2c1c-4959-b2fd-55ac7f9a007e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:56.290186 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1e3cde3-2c1c-4959-b2fd-55ac7f9a007e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:56.291232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1e3cde3-2c1c-4959-b2fd-55ac7f9a007e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:56.291667 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1e3cde3-2c1c-4959-b2fd-55ac7f9a007e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:56.350947 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c1e3cde3-2c1c-4959-b2fd-55ac7f9a007e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:56.358486 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c1e3cde3-2c1c-4959-b2fd-55ac7f9a007e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078701 Jul 19 09:46:56.359050 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 910/1791] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:56 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:57.373497 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d88fdf75-823c-4408-a772-babe8c850667 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:57.374148 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d88fdf75-823c-4408-a772-babe8c850667 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:57.379910 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d88fdf75-823c-4408-a772-babe8c850667 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:57.380363 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d88fdf75-823c-4408-a772-babe8c850667 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:57.381132 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d88fdf75-823c-4408-a772-babe8c850667 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:57.381575 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d88fdf75-823c-4408-a772-babe8c850667 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:57.442803 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d88fdf75-823c-4408-a772-babe8c850667 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:57.450563 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d88fdf75-823c-4408-a772-babe8c850667 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080734 Jul 19 09:46:57.451138 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 882/1792] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:57 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:58.466004 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8d976706-6111-4f93-9a00-5a35075c2022 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:58.466614 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8d976706-6111-4f93-9a00-5a35075c2022 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:58.472289 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d976706-6111-4f93-9a00-5a35075c2022 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:58.472742 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d976706-6111-4f93-9a00-5a35075c2022 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:58.473502 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d976706-6111-4f93-9a00-5a35075c2022 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:58.473934 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8d976706-6111-4f93-9a00-5a35075c2022 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:58.533260 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8d976706-6111-4f93-9a00-5a35075c2022 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:58.541120 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8d976706-6111-4f93-9a00-5a35075c2022 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078689 Jul 19 09:46:58.541673 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 911/1793] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:58 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:46:59.557388 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6443bdf7-b4cf-4147-a21e-163f7f45c9ed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:46:59.558001 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6443bdf7-b4cf-4147-a21e-163f7f45c9ed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:46:59.563792 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6443bdf7-b4cf-4147-a21e-163f7f45c9ed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:59.564294 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6443bdf7-b4cf-4147-a21e-163f7f45c9ed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:59.565080 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6443bdf7-b4cf-4147-a21e-163f7f45c9ed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:46:59.565516 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6443bdf7-b4cf-4147-a21e-163f7f45c9ed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:46:59.628398 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6443bdf7-b4cf-4147-a21e-163f7f45c9ed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:46:59.636128 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6443bdf7-b4cf-4147-a21e-163f7f45c9ed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.082330 Jul 19 09:46:59.636686 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 883/1794] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:46:59 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:00.651425 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5878bee3-7ab7-4fca-a3a3-9bc37c109a46 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:00.652037 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5878bee3-7ab7-4fca-a3a3-9bc37c109a46 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:00.658017 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5878bee3-7ab7-4fca-a3a3-9bc37c109a46 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:00.658464 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5878bee3-7ab7-4fca-a3a3-9bc37c109a46 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:00.659262 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5878bee3-7ab7-4fca-a3a3-9bc37c109a46 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:00.659698 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5878bee3-7ab7-4fca-a3a3-9bc37c109a46 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:00.719385 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5878bee3-7ab7-4fca-a3a3-9bc37c109a46 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:00.726883 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5878bee3-7ab7-4fca-a3a3-9bc37c109a46 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079091 Jul 19 09:47:00.727486 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 912/1795] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:00 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:01.743352 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-057eb7bd-a1aa-4fc0-b7bd-d7386f26392a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:01.743956 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-057eb7bd-a1aa-4fc0-b7bd-d7386f26392a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:01.749705 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-057eb7bd-a1aa-4fc0-b7bd-d7386f26392a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:01.750144 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-057eb7bd-a1aa-4fc0-b7bd-d7386f26392a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:01.750896 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-057eb7bd-a1aa-4fc0-b7bd-d7386f26392a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:01.751348 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-057eb7bd-a1aa-4fc0-b7bd-d7386f26392a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:01.810829 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-057eb7bd-a1aa-4fc0-b7bd-d7386f26392a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:01.818537 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-057eb7bd-a1aa-4fc0-b7bd-d7386f26392a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078755 Jul 19 09:47:01.819108 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 884/1796] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:01 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:02.834539 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e1e3362d-715f-4067-9a02-f5a4feb7d241 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:02.835171 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e1e3362d-715f-4067-9a02-f5a4feb7d241 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:02.840904 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e1e3362d-715f-4067-9a02-f5a4feb7d241 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:02.841352 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e1e3362d-715f-4067-9a02-f5a4feb7d241 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:02.842106 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e1e3362d-715f-4067-9a02-f5a4feb7d241 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:02.842539 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e1e3362d-715f-4067-9a02-f5a4feb7d241 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:02.903964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e1e3362d-715f-4067-9a02-f5a4feb7d241 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:02.911398 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e1e3362d-715f-4067-9a02-f5a4feb7d241 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080411 Jul 19 09:47:02.911955 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 913/1797] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:02 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:03.928146 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6d5a0b4a-f709-401b-be5d-49cc4cd094d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:03.928751 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6d5a0b4a-f709-401b-be5d-49cc4cd094d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:03.934926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6d5a0b4a-f709-401b-be5d-49cc4cd094d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:03.935406 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6d5a0b4a-f709-401b-be5d-49cc4cd094d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:03.936157 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6d5a0b4a-f709-401b-be5d-49cc4cd094d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:03.936585 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6d5a0b4a-f709-401b-be5d-49cc4cd094d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:03.995710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6d5a0b4a-f709-401b-be5d-49cc4cd094d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:04.003861 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6d5a0b4a-f709-401b-be5d-49cc4cd094d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079312 Jul 19 09:47:04.004357 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 885/1798] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:03 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:05.020728 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f9c792eb-73c1-48a7-ae88-936865494f86 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:05.021275 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f9c792eb-73c1-48a7-ae88-936865494f86 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:05.026965 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9c792eb-73c1-48a7-ae88-936865494f86 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:05.028048 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9c792eb-73c1-48a7-ae88-936865494f86 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:05.028851 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9c792eb-73c1-48a7-ae88-936865494f86 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:05.029281 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9c792eb-73c1-48a7-ae88-936865494f86 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:05.087607 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f9c792eb-73c1-48a7-ae88-936865494f86 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:05.095707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f9c792eb-73c1-48a7-ae88-936865494f86 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078636 Jul 19 09:47:05.096265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 914/1799] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:05 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:06.112249 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-4f644100-3364-4e2a-ace1-c14c7b1e82ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:06.112790 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-4f644100-3364-4e2a-ace1-c14c7b1e82ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:06.118565 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4f644100-3364-4e2a-ace1-c14c7b1e82ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:06.119016 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4f644100-3364-4e2a-ace1-c14c7b1e82ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:06.119794 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4f644100-3364-4e2a-ace1-c14c7b1e82ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:06.120224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-4f644100-3364-4e2a-ace1-c14c7b1e82ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:06.181286 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-4f644100-3364-4e2a-ace1-c14c7b1e82ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:06.188899 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-4f644100-3364-4e2a-ace1-c14c7b1e82ac tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080308 Jul 19 09:47:06.189456 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 886/1800] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:06 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:07.205682 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-50f28769-8203-4a58-953d-54b1e322ab49 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:07.206284 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-50f28769-8203-4a58-953d-54b1e322ab49 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:07.212103 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-50f28769-8203-4a58-953d-54b1e322ab49 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:07.212547 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-50f28769-8203-4a58-953d-54b1e322ab49 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:07.213297 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-50f28769-8203-4a58-953d-54b1e322ab49 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:07.213725 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-50f28769-8203-4a58-953d-54b1e322ab49 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:07.272359 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-50f28769-8203-4a58-953d-54b1e322ab49 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:07.279726 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-50f28769-8203-4a58-953d-54b1e322ab49 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.077729 Jul 19 09:47:07.280281 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 915/1801] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:07 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:08.296944 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6741665d-ae90-4ab3-b441-e0ca3d721777 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:08.297498 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6741665d-ae90-4ab3-b441-e0ca3d721777 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:08.303258 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6741665d-ae90-4ab3-b441-e0ca3d721777 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:08.303711 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6741665d-ae90-4ab3-b441-e0ca3d721777 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:08.304501 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6741665d-ae90-4ab3-b441-e0ca3d721777 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:08.304933 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6741665d-ae90-4ab3-b441-e0ca3d721777 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:08.368318 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6741665d-ae90-4ab3-b441-e0ca3d721777 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:08.376667 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6741665d-ae90-4ab3-b441-e0ca3d721777 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.084143 Jul 19 09:47:08.377227 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 887/1802] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:08 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:09.393507 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-82da96e3-f963-4d1f-b3c9-3f8983ea4911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:09.394088 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-82da96e3-f963-4d1f-b3c9-3f8983ea4911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:09.399865 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-82da96e3-f963-4d1f-b3c9-3f8983ea4911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:09.400307 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-82da96e3-f963-4d1f-b3c9-3f8983ea4911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:09.401053 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-82da96e3-f963-4d1f-b3c9-3f8983ea4911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:09.401479 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-82da96e3-f963-4d1f-b3c9-3f8983ea4911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:09.460454 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-82da96e3-f963-4d1f-b3c9-3f8983ea4911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:09.468229 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-82da96e3-f963-4d1f-b3c9-3f8983ea4911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078544 Jul 19 09:47:09.468783 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 916/1803] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:09 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:10.484491 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1c60c041-8392-4225-b7f6-0157bdc9865e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:10.485090 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1c60c041-8392-4225-b7f6-0157bdc9865e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:10.490900 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c60c041-8392-4225-b7f6-0157bdc9865e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:10.491373 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c60c041-8392-4225-b7f6-0157bdc9865e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:10.492140 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c60c041-8392-4225-b7f6-0157bdc9865e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:10.492568 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1c60c041-8392-4225-b7f6-0157bdc9865e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:10.552865 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1c60c041-8392-4225-b7f6-0157bdc9865e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:10.561105 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1c60c041-8392-4225-b7f6-0157bdc9865e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080757 Jul 19 09:47:10.561660 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 888/1804] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:10 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:11.577833 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-33cbd901-25b3-4932-9d86-4cbae32f7105 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:11.578427 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-33cbd901-25b3-4932-9d86-4cbae32f7105 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:11.584201 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33cbd901-25b3-4932-9d86-4cbae32f7105 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:11.584644 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33cbd901-25b3-4932-9d86-4cbae32f7105 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:11.585396 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33cbd901-25b3-4932-9d86-4cbae32f7105 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:11.585822 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33cbd901-25b3-4932-9d86-4cbae32f7105 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:11.852281 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-33cbd901-25b3-4932-9d86-4cbae32f7105 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:11.860524 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-33cbd901-25b3-4932-9d86-4cbae32f7105 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.286961 Jul 19 09:47:11.861082 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 917/1805] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:11 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:12.877242 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-222dab84-b8b1-4df4-b21f-600b2ba95c07 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:12.877783 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-222dab84-b8b1-4df4-b21f-600b2ba95c07 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:12.883801 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-222dab84-b8b1-4df4-b21f-600b2ba95c07 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:12.884250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-222dab84-b8b1-4df4-b21f-600b2ba95c07 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:12.885024 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-222dab84-b8b1-4df4-b21f-600b2ba95c07 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:12.885503 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-222dab84-b8b1-4df4-b21f-600b2ba95c07 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:12.945224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-222dab84-b8b1-4df4-b21f-600b2ba95c07 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:12.952801 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-222dab84-b8b1-4df4-b21f-600b2ba95c07 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079296 Jul 19 09:47:12.953361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 889/1806] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:12 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:13.968745 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8ad5dd2a-4bcf-4917-bc2b-8465ee285886 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:13.969352 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8ad5dd2a-4bcf-4917-bc2b-8465ee285886 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:13.975230 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8ad5dd2a-4bcf-4917-bc2b-8465ee285886 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:13.975681 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8ad5dd2a-4bcf-4917-bc2b-8465ee285886 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:13.976434 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8ad5dd2a-4bcf-4917-bc2b-8465ee285886 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:13.976869 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8ad5dd2a-4bcf-4917-bc2b-8465ee285886 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:14.035612 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8ad5dd2a-4bcf-4917-bc2b-8465ee285886 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:14.044049 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8ad5dd2a-4bcf-4917-bc2b-8465ee285886 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078980 Jul 19 09:47:14.044612 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 918/1807] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:13 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:14.244382 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:47:14.244842 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:47:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:47:15.060639 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2941683a-1b71-472d-9122-9ee9f43d8c88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:15.061252 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2941683a-1b71-472d-9122-9ee9f43d8c88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:15.067224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2941683a-1b71-472d-9122-9ee9f43d8c88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:15.067675 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2941683a-1b71-472d-9122-9ee9f43d8c88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:15.068445 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2941683a-1b71-472d-9122-9ee9f43d8c88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:15.068878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2941683a-1b71-472d-9122-9ee9f43d8c88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:15.130315 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2941683a-1b71-472d-9122-9ee9f43d8c88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:15.139297 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2941683a-1b71-472d-9122-9ee9f43d8c88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.081700 Jul 19 09:47:15.139297 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 890/1808] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:15 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:16.155551 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c1e67447-994c-4f53-a09e-f648b47b125e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:16.156247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c1e67447-994c-4f53-a09e-f648b47b125e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:16.162636 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1e67447-994c-4f53-a09e-f648b47b125e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:16.163152 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1e67447-994c-4f53-a09e-f648b47b125e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:16.163910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1e67447-994c-4f53-a09e-f648b47b125e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:16.164348 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c1e67447-994c-4f53-a09e-f648b47b125e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:16.224466 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c1e67447-994c-4f53-a09e-f648b47b125e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:16.232637 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c1e67447-994c-4f53-a09e-f648b47b125e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.081183 Jul 19 09:47:16.233196 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 919/1809] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:16 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:17.249746 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cab4b80f-3c5c-4872-9273-3a9ec7f6bd0f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:17.250366 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cab4b80f-3c5c-4872-9273-3a9ec7f6bd0f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:17.256273 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cab4b80f-3c5c-4872-9273-3a9ec7f6bd0f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:17.256729 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cab4b80f-3c5c-4872-9273-3a9ec7f6bd0f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:17.257503 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cab4b80f-3c5c-4872-9273-3a9ec7f6bd0f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:17.257964 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cab4b80f-3c5c-4872-9273-3a9ec7f6bd0f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:17.324024 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cab4b80f-3c5c-4872-9273-3a9ec7f6bd0f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:17.332145 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cab4b80f-3c5c-4872-9273-3a9ec7f6bd0f tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.086930 Jul 19 09:47:17.332931 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 891/1810] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:17 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:18.406743 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-df79fdb5-6606-4937-bc48-fa5c724dd911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:18.407404 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-df79fdb5-6606-4937-bc48-fa5c724dd911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:18.413048 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-df79fdb5-6606-4937-bc48-fa5c724dd911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:18.413500 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-df79fdb5-6606-4937-bc48-fa5c724dd911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:18.414258 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-df79fdb5-6606-4937-bc48-fa5c724dd911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:18.414695 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-df79fdb5-6606-4937-bc48-fa5c724dd911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:18.474272 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-df79fdb5-6606-4937-bc48-fa5c724dd911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:18.482509 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-df79fdb5-6606-4937-bc48-fa5c724dd911 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.138452 Jul 19 09:47:18.483074 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 920/1811] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:18 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:19.498140 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-025bd335-1edd-40b9-b2f1-88fd02eaa642 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:19.498753 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-025bd335-1edd-40b9-b2f1-88fd02eaa642 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:19.504475 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-025bd335-1edd-40b9-b2f1-88fd02eaa642 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:19.504921 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-025bd335-1edd-40b9-b2f1-88fd02eaa642 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:19.505687 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-025bd335-1edd-40b9-b2f1-88fd02eaa642 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:19.506121 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-025bd335-1edd-40b9-b2f1-88fd02eaa642 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:19.565645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-025bd335-1edd-40b9-b2f1-88fd02eaa642 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:19.573176 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-025bd335-1edd-40b9-b2f1-88fd02eaa642 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078704 Jul 19 09:47:19.574245 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 892/1812] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:19 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:20.589283 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f9fba1c2-e77a-4297-9e5f-4f68420187d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:20.590443 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f9fba1c2-e77a-4297-9e5f-4f68420187d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:20.596165 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9fba1c2-e77a-4297-9e5f-4f68420187d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:20.596628 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9fba1c2-e77a-4297-9e5f-4f68420187d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:20.597398 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9fba1c2-e77a-4297-9e5f-4f68420187d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:20.597832 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f9fba1c2-e77a-4297-9e5f-4f68420187d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:20.660681 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f9fba1c2-e77a-4297-9e5f-4f68420187d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:20.669483 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f9fba1c2-e77a-4297-9e5f-4f68420187d2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.083841 Jul 19 09:47:20.670033 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 921/1813] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:20 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:21.685810 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ef373b11-7395-44fe-8e99-0166d133ebe9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:21.686427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ef373b11-7395-44fe-8e99-0166d133ebe9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:21.692197 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ef373b11-7395-44fe-8e99-0166d133ebe9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:21.692650 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ef373b11-7395-44fe-8e99-0166d133ebe9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:21.693560 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ef373b11-7395-44fe-8e99-0166d133ebe9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:21.693846 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ef373b11-7395-44fe-8e99-0166d133ebe9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:21.756104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ef373b11-7395-44fe-8e99-0166d133ebe9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:21.764087 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ef373b11-7395-44fe-8e99-0166d133ebe9 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.082545 Jul 19 09:47:21.764644 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 893/1814] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:21 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:22.780152 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3b937118-bab2-4901-acc3-c2ee1b36c600 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:22.780759 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3b937118-bab2-4901-acc3-c2ee1b36c600 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:22.786461 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3b937118-bab2-4901-acc3-c2ee1b36c600 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:22.786903 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3b937118-bab2-4901-acc3-c2ee1b36c600 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:22.787701 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3b937118-bab2-4901-acc3-c2ee1b36c600 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:22.788131 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3b937118-bab2-4901-acc3-c2ee1b36c600 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:22.847021 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3b937118-bab2-4901-acc3-c2ee1b36c600 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:22.854510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3b937118-bab2-4901-acc3-c2ee1b36c600 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078016 Jul 19 09:47:22.855084 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 922/1815] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:22 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:23.870975 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-80b56dbb-2e4e-412c-944f-ce3594730142 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:23.871609 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-80b56dbb-2e4e-412c-944f-ce3594730142 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:23.877343 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-80b56dbb-2e4e-412c-944f-ce3594730142 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:23.877794 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-80b56dbb-2e4e-412c-944f-ce3594730142 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:23.878557 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-80b56dbb-2e4e-412c-944f-ce3594730142 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:23.878990 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-80b56dbb-2e4e-412c-944f-ce3594730142 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:23.938247 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-80b56dbb-2e4e-412c-944f-ce3594730142 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:23.946179 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-80b56dbb-2e4e-412c-944f-ce3594730142 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078856 Jul 19 09:47:23.946739 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 894/1816] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:23 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:24.962885 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-34939032-ed63-4dca-89c2-8106ed5c15d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:24.963522 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-34939032-ed63-4dca-89c2-8106ed5c15d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:24.969850 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-34939032-ed63-4dca-89c2-8106ed5c15d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:24.970304 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-34939032-ed63-4dca-89c2-8106ed5c15d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:24.971095 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-34939032-ed63-4dca-89c2-8106ed5c15d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:24.971538 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-34939032-ed63-4dca-89c2-8106ed5c15d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:25.030575 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-34939032-ed63-4dca-89c2-8106ed5c15d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:25.038097 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-34939032-ed63-4dca-89c2-8106ed5c15d4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078856 Jul 19 09:47:25.038659 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 923/1817] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:24 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:26.055199 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ec9e9dd9-0d0b-4836-b326-7f26dd5b5055 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:26.055812 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ec9e9dd9-0d0b-4836-b326-7f26dd5b5055 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:26.062241 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec9e9dd9-0d0b-4836-b326-7f26dd5b5055 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:26.062692 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec9e9dd9-0d0b-4836-b326-7f26dd5b5055 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:26.063481 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec9e9dd9-0d0b-4836-b326-7f26dd5b5055 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:26.063923 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ec9e9dd9-0d0b-4836-b326-7f26dd5b5055 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:26.126076 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ec9e9dd9-0d0b-4836-b326-7f26dd5b5055 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:26.133608 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ec9e9dd9-0d0b-4836-b326-7f26dd5b5055 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.082158 Jul 19 09:47:26.134165 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 895/1818] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:26 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:27.149926 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8c351316-f039-489c-8703-1570e4c1c8f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:27.150495 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8c351316-f039-489c-8703-1570e4c1c8f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:27.156797 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8c351316-f039-489c-8703-1570e4c1c8f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:27.157247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8c351316-f039-489c-8703-1570e4c1c8f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:27.158018 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8c351316-f039-489c-8703-1570e4c1c8f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:27.158454 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8c351316-f039-489c-8703-1570e4c1c8f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:27.218470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8c351316-f039-489c-8703-1570e4c1c8f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:27.226015 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8c351316-f039-489c-8703-1570e4c1c8f5 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079911 Jul 19 09:47:27.226574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 924/1819] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:27 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:28.242382 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-27fd98c8-adf6-4657-bd53-3de75b864457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:28.243017 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-27fd98c8-adf6-4657-bd53-3de75b864457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:28.249464 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-27fd98c8-adf6-4657-bd53-3de75b864457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:28.249913 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-27fd98c8-adf6-4657-bd53-3de75b864457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:28.250676 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-27fd98c8-adf6-4657-bd53-3de75b864457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:28.251134 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-27fd98c8-adf6-4657-bd53-3de75b864457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:28.311494 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-27fd98c8-adf6-4657-bd53-3de75b864457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:28.319321 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-27fd98c8-adf6-4657-bd53-3de75b864457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080632 Jul 19 09:47:28.319878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 896/1820] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:28 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:29.335739 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-03405fff-deed-41ad-9da9-598567beb457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:29.336280 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-03405fff-deed-41ad-9da9-598567beb457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:29.342617 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-03405fff-deed-41ad-9da9-598567beb457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:29.343080 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-03405fff-deed-41ad-9da9-598567beb457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:29.343835 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-03405fff-deed-41ad-9da9-598567beb457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:29.344265 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-03405fff-deed-41ad-9da9-598567beb457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:29.405339 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-03405fff-deed-41ad-9da9-598567beb457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:29.412880 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-03405fff-deed-41ad-9da9-598567beb457 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.081006 Jul 19 09:47:29.413436 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 925/1821] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:29 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:30.429294 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d5f582ec-7c28-4ab0-b31f-586a54e541e4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:30.429907 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d5f582ec-7c28-4ab0-b31f-586a54e541e4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:30.435844 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d5f582ec-7c28-4ab0-b31f-586a54e541e4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:30.436292 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d5f582ec-7c28-4ab0-b31f-586a54e541e4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:30.437051 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d5f582ec-7c28-4ab0-b31f-586a54e541e4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:30.437483 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d5f582ec-7c28-4ab0-b31f-586a54e541e4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:30.496975 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d5f582ec-7c28-4ab0-b31f-586a54e541e4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:30.504500 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d5f582ec-7c28-4ab0-b31f-586a54e541e4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078848 Jul 19 09:47:30.505058 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 897/1822] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:30 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:31.521261 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-294653ed-6dd6-475f-a7f3-cb87c18cfb3d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:31.521895 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-294653ed-6dd6-475f-a7f3-cb87c18cfb3d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:31.527584 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-294653ed-6dd6-475f-a7f3-cb87c18cfb3d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:31.528033 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-294653ed-6dd6-475f-a7f3-cb87c18cfb3d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:31.528798 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-294653ed-6dd6-475f-a7f3-cb87c18cfb3d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:31.529230 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-294653ed-6dd6-475f-a7f3-cb87c18cfb3d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:31.588061 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-294653ed-6dd6-475f-a7f3-cb87c18cfb3d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:31.595520 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-294653ed-6dd6-475f-a7f3-cb87c18cfb3d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.077885 Jul 19 09:47:31.596073 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 926/1823] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:31 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:32.611621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-93870dad-8628-4f99-aed1-1742312f0f4a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:32.612238 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-93870dad-8628-4f99-aed1-1742312f0f4a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:32.618251 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93870dad-8628-4f99-aed1-1742312f0f4a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:32.618570 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93870dad-8628-4f99-aed1-1742312f0f4a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:32.619397 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93870dad-8628-4f99-aed1-1742312f0f4a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:32.619830 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93870dad-8628-4f99-aed1-1742312f0f4a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:32.679292 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-93870dad-8628-4f99-aed1-1742312f0f4a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:32.687286 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-93870dad-8628-4f99-aed1-1742312f0f4a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079304 Jul 19 09:47:32.687862 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 898/1824] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:32 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:33.703927 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-763bb2ef-43dc-4747-bf13-200f7deaef8e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:33.704544 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-763bb2ef-43dc-4747-bf13-200f7deaef8e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:33.710272 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-763bb2ef-43dc-4747-bf13-200f7deaef8e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:33.710754 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-763bb2ef-43dc-4747-bf13-200f7deaef8e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:33.711547 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-763bb2ef-43dc-4747-bf13-200f7deaef8e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:33.711984 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-763bb2ef-43dc-4747-bf13-200f7deaef8e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:33.770606 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-763bb2ef-43dc-4747-bf13-200f7deaef8e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:33.778735 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-763bb2ef-43dc-4747-bf13-200f7deaef8e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078468 Jul 19 09:47:33.779325 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 927/1825] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:33 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:34.799488 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-48b9efd8-0864-46db-879f-f01dc3495899 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:34.800095 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-48b9efd8-0864-46db-879f-f01dc3495899 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:34.805828 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-48b9efd8-0864-46db-879f-f01dc3495899 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:34.806272 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-48b9efd8-0864-46db-879f-f01dc3495899 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:34.807024 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-48b9efd8-0864-46db-879f-f01dc3495899 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:34.807544 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-48b9efd8-0864-46db-879f-f01dc3495899 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:34.869380 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-48b9efd8-0864-46db-879f-f01dc3495899 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:34.877000 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-48b9efd8-0864-46db-879f-f01dc3495899 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.081162 Jul 19 09:47:34.877558 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 899/1826] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:34 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:35.893128 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-067aadd9-e9e6-430d-958f-308705a6768c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:35.893734 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-067aadd9-e9e6-430d-958f-308705a6768c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:35.899564 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-067aadd9-e9e6-430d-958f-308705a6768c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:35.900014 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-067aadd9-e9e6-430d-958f-308705a6768c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:35.900770 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-067aadd9-e9e6-430d-958f-308705a6768c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:35.901203 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-067aadd9-e9e6-430d-958f-308705a6768c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:35.960525 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-067aadd9-e9e6-430d-958f-308705a6768c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:35.968660 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-067aadd9-e9e6-430d-958f-308705a6768c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079216 Jul 19 09:47:35.969224 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 928/1827] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:35 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:36.984882 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a1318de2-151b-40b7-8813-21a0c4d11671 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:36.985491 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a1318de2-151b-40b7-8813-21a0c4d11671 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:36.991498 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a1318de2-151b-40b7-8813-21a0c4d11671 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:36.991950 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a1318de2-151b-40b7-8813-21a0c4d11671 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:36.992718 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a1318de2-151b-40b7-8813-21a0c4d11671 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:36.993160 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a1318de2-151b-40b7-8813-21a0c4d11671 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:37.053529 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a1318de2-151b-40b7-8813-21a0c4d11671 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:37.061541 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a1318de2-151b-40b7-8813-21a0c4d11671 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080394 Jul 19 09:47:37.062091 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 900/1828] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:36 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:38.078293 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b01d004f-046e-4ce1-8c9a-0ef42266683e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:38.078906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b01d004f-046e-4ce1-8c9a-0ef42266683e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:38.084884 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b01d004f-046e-4ce1-8c9a-0ef42266683e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:38.085340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b01d004f-046e-4ce1-8c9a-0ef42266683e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:38.086107 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b01d004f-046e-4ce1-8c9a-0ef42266683e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:38.086547 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b01d004f-046e-4ce1-8c9a-0ef42266683e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:38.147950 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b01d004f-046e-4ce1-8c9a-0ef42266683e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:38.156167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b01d004f-046e-4ce1-8c9a-0ef42266683e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.081617 Jul 19 09:47:38.156728 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 929/1829] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:38 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:39.172102 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-168e6831-bfd2-429a-8a56-a370bc5d2487 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:39.172711 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-168e6831-bfd2-429a-8a56-a370bc5d2487 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:39.178577 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-168e6831-bfd2-429a-8a56-a370bc5d2487 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:39.179023 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-168e6831-bfd2-429a-8a56-a370bc5d2487 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:39.179807 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-168e6831-bfd2-429a-8a56-a370bc5d2487 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:39.180242 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-168e6831-bfd2-429a-8a56-a370bc5d2487 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:39.240062 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-168e6831-bfd2-429a-8a56-a370bc5d2487 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:39.248261 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-168e6831-bfd2-429a-8a56-a370bc5d2487 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079873 Jul 19 09:47:39.248819 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 901/1830] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:39 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:40.263940 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-45474cbb-0bb2-4de9-897e-7eb6fa456c21 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:40.264545 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-45474cbb-0bb2-4de9-897e-7eb6fa456c21 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:40.270487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-45474cbb-0bb2-4de9-897e-7eb6fa456c21 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:40.270939 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-45474cbb-0bb2-4de9-897e-7eb6fa456c21 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:40.271733 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-45474cbb-0bb2-4de9-897e-7eb6fa456c21 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:40.272165 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-45474cbb-0bb2-4de9-897e-7eb6fa456c21 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:40.331948 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-45474cbb-0bb2-4de9-897e-7eb6fa456c21 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:40.340303 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-45474cbb-0bb2-4de9-897e-7eb6fa456c21 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080471 Jul 19 09:47:40.340974 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 930/1831] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:40 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:41.362430 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8e7ff50b-683b-48f6-9037-6c93306f1aba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:41.363060 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8e7ff50b-683b-48f6-9037-6c93306f1aba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:41.368849 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8e7ff50b-683b-48f6-9037-6c93306f1aba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:41.369471 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8e7ff50b-683b-48f6-9037-6c93306f1aba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:41.370655 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8e7ff50b-683b-48f6-9037-6c93306f1aba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:41.371158 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8e7ff50b-683b-48f6-9037-6c93306f1aba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:41.432092 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8e7ff50b-683b-48f6-9037-6c93306f1aba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:41.439600 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8e7ff50b-683b-48f6-9037-6c93306f1aba tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080798 Jul 19 09:47:41.440150 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 902/1832] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:41 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:42.455999 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0632a9a6-5164-4689-ab5b-ed3d5418fbfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:42.456603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-0632a9a6-5164-4689-ab5b-ed3d5418fbfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:42.462340 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0632a9a6-5164-4689-ab5b-ed3d5418fbfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:42.462786 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0632a9a6-5164-4689-ab5b-ed3d5418fbfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:42.463577 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0632a9a6-5164-4689-ab5b-ed3d5418fbfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:42.464014 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-0632a9a6-5164-4689-ab5b-ed3d5418fbfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:42.522552 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-0632a9a6-5164-4689-ab5b-ed3d5418fbfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:42.530244 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0632a9a6-5164-4689-ab5b-ed3d5418fbfe tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.077902 Jul 19 09:47:42.530800 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 931/1833] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:42 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:43.546520 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-47323e02-eafb-4ea3-b038-fbd10b531195 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:43.547150 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-47323e02-eafb-4ea3-b038-fbd10b531195 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:43.552889 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-47323e02-eafb-4ea3-b038-fbd10b531195 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:43.553343 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-47323e02-eafb-4ea3-b038-fbd10b531195 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:43.554103 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-47323e02-eafb-4ea3-b038-fbd10b531195 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:43.554539 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-47323e02-eafb-4ea3-b038-fbd10b531195 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:43.616821 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-47323e02-eafb-4ea3-b038-fbd10b531195 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:43.624963 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-47323e02-eafb-4ea3-b038-fbd10b531195 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.082149 Jul 19 09:47:43.625523 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 903/1834] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:43 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:44.640572 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cc5885ec-e0c7-4cdf-83f8-987859a0ae85 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:44.641184 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-cc5885ec-e0c7-4cdf-83f8-987859a0ae85 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:44.646941 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc5885ec-e0c7-4cdf-83f8-987859a0ae85 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:44.647427 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc5885ec-e0c7-4cdf-83f8-987859a0ae85 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:44.648190 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc5885ec-e0c7-4cdf-83f8-987859a0ae85 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:44.648631 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cc5885ec-e0c7-4cdf-83f8-987859a0ae85 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:44.707771 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cc5885ec-e0c7-4cdf-83f8-987859a0ae85 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:44.716165 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-cc5885ec-e0c7-4cdf-83f8-987859a0ae85 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079154 Jul 19 09:47:44.716671 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 932/1835] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:44 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:45.732488 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-35b9d2c5-be13-4570-bc01-bb0a4fa2b7ca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:45.733242 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-35b9d2c5-be13-4570-bc01-bb0a4fa2b7ca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:45.738866 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-35b9d2c5-be13-4570-bc01-bb0a4fa2b7ca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:45.739331 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-35b9d2c5-be13-4570-bc01-bb0a4fa2b7ca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:45.740089 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-35b9d2c5-be13-4570-bc01-bb0a4fa2b7ca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:45.740515 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-35b9d2c5-be13-4570-bc01-bb0a4fa2b7ca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:45.800556 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-35b9d2c5-be13-4570-bc01-bb0a4fa2b7ca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:45.808568 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-35b9d2c5-be13-4570-bc01-bb0a4fa2b7ca tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079628 Jul 19 09:47:45.809132 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 904/1836] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:45 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:46.824699 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e101d2e4-13fb-49b0-a995-d2265ff20ca2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:46.825238 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e101d2e4-13fb-49b0-a995-d2265ff20ca2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:46.830875 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e101d2e4-13fb-49b0-a995-d2265ff20ca2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:46.831344 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e101d2e4-13fb-49b0-a995-d2265ff20ca2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:46.832103 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e101d2e4-13fb-49b0-a995-d2265ff20ca2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:46.832530 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e101d2e4-13fb-49b0-a995-d2265ff20ca2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:46.894996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e101d2e4-13fb-49b0-a995-d2265ff20ca2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:46.903062 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e101d2e4-13fb-49b0-a995-d2265ff20ca2 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.082002 Jul 19 09:47:46.907244 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 933/1837] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:46 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:47.919793 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7dd124b8-0f6c-417c-827a-3c744b97301c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:47.920429 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7dd124b8-0f6c-417c-827a-3c744b97301c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:47.926153 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7dd124b8-0f6c-417c-827a-3c744b97301c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:47.926679 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7dd124b8-0f6c-417c-827a-3c744b97301c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:47.927645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7dd124b8-0f6c-417c-827a-3c744b97301c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:47.928167 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7dd124b8-0f6c-417c-827a-3c744b97301c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:47.988196 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7dd124b8-0f6c-417c-827a-3c744b97301c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:47.996341 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7dd124b8-0f6c-417c-827a-3c744b97301c tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.081255 Jul 19 09:47:47.996929 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 905/1838] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:47 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:49.012211 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ea8aed78-6052-4ca0-bf7a-169e5828d56b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:49.012822 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ea8aed78-6052-4ca0-bf7a-169e5828d56b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:49.018564 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ea8aed78-6052-4ca0-bf7a-169e5828d56b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:49.019018 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ea8aed78-6052-4ca0-bf7a-169e5828d56b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:49.019810 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ea8aed78-6052-4ca0-bf7a-169e5828d56b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:49.020240 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ea8aed78-6052-4ca0-bf7a-169e5828d56b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:49.078991 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ea8aed78-6052-4ca0-bf7a-169e5828d56b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:49.086386 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ea8aed78-6052-4ca0-bf7a-169e5828d56b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078340 Jul 19 09:47:49.086935 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 934/1839] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:49 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:50.101613 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8691b613-82bc-43c7-92f7-4851a72e008e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:50.102224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8691b613-82bc-43c7-92f7-4851a72e008e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:50.107951 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8691b613-82bc-43c7-92f7-4851a72e008e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:50.108424 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8691b613-82bc-43c7-92f7-4851a72e008e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:50.109186 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8691b613-82bc-43c7-92f7-4851a72e008e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:50.109622 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8691b613-82bc-43c7-92f7-4851a72e008e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:50.172278 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8691b613-82bc-43c7-92f7-4851a72e008e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:50.180065 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8691b613-82bc-43c7-92f7-4851a72e008e tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.082146 Jul 19 09:47:50.180623 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 906/1840] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:50 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:51.195342 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-2bbc204b-ee0c-4875-99eb-ea9cdf63a0a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:51.195951 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-2bbc204b-ee0c-4875-99eb-ea9cdf63a0a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:51.201797 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2bbc204b-ee0c-4875-99eb-ea9cdf63a0a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:51.202243 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2bbc204b-ee0c-4875-99eb-ea9cdf63a0a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:51.202999 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2bbc204b-ee0c-4875-99eb-ea9cdf63a0a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:51.203457 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-2bbc204b-ee0c-4875-99eb-ea9cdf63a0a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:51.262347 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-2bbc204b-ee0c-4875-99eb-ea9cdf63a0a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:51.270249 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-2bbc204b-ee0c-4875-99eb-ea9cdf63a0a6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078526 Jul 19 09:47:51.270819 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 935/1841] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:51 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:52.287449 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c62a215d-43de-4bf0-9c23-31e2f1dc4230 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:52.288063 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c62a215d-43de-4bf0-9c23-31e2f1dc4230 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:52.294615 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c62a215d-43de-4bf0-9c23-31e2f1dc4230 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:52.295100 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c62a215d-43de-4bf0-9c23-31e2f1dc4230 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:52.295876 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c62a215d-43de-4bf0-9c23-31e2f1dc4230 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:52.296315 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c62a215d-43de-4bf0-9c23-31e2f1dc4230 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:52.355288 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c62a215d-43de-4bf0-9c23-31e2f1dc4230 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:52.362840 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c62a215d-43de-4bf0-9c23-31e2f1dc4230 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079023 Jul 19 09:47:52.363446 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 907/1842] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:52 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:53.379484 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5834c1bd-af29-49b5-a169-59095d30b462 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:53.380096 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5834c1bd-af29-49b5-a169-59095d30b462 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:53.386444 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5834c1bd-af29-49b5-a169-59095d30b462 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:53.386867 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5834c1bd-af29-49b5-a169-59095d30b462 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:53.387628 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5834c1bd-af29-49b5-a169-59095d30b462 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:53.388055 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5834c1bd-af29-49b5-a169-59095d30b462 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:53.446417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-5834c1bd-af29-49b5-a169-59095d30b462 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:53.454551 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5834c1bd-af29-49b5-a169-59095d30b462 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078614 Jul 19 09:47:53.455129 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 936/1843] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:53 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:54.470640 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a0807d85-41cb-46d5-b098-0d375b48200b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:54.471209 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a0807d85-41cb-46d5-b098-0d375b48200b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:54.476953 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a0807d85-41cb-46d5-b098-0d375b48200b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:54.477393 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a0807d85-41cb-46d5-b098-0d375b48200b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:54.478237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a0807d85-41cb-46d5-b098-0d375b48200b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:54.478665 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a0807d85-41cb-46d5-b098-0d375b48200b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:54.538534 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a0807d85-41cb-46d5-b098-0d375b48200b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:54.546229 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a0807d85-41cb-46d5-b098-0d375b48200b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079177 Jul 19 09:47:54.546786 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 908/1844] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:54 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:55.562885 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-cf8e9ab8-9f5f-4b7f-bf53-d9f6c2c9399d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:55.563458 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-cf8e9ab8-9f5f-4b7f-bf53-d9f6c2c9399d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:55.569272 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf8e9ab8-9f5f-4b7f-bf53-d9f6c2c9399d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:55.569728 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf8e9ab8-9f5f-4b7f-bf53-d9f6c2c9399d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:55.570494 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf8e9ab8-9f5f-4b7f-bf53-d9f6c2c9399d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:55.570934 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-cf8e9ab8-9f5f-4b7f-bf53-d9f6c2c9399d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:55.632124 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-cf8e9ab8-9f5f-4b7f-bf53-d9f6c2c9399d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:55.639912 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-cf8e9ab8-9f5f-4b7f-bf53-d9f6c2c9399d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080705 Jul 19 09:47:55.640474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 937/1845] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:55 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:56.655960 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9ebe0fe6-285a-4af8-b3ce-f2159e1f08ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:56.656604 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9ebe0fe6-285a-4af8-b3ce-f2159e1f08ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:56.662461 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ebe0fe6-285a-4af8-b3ce-f2159e1f08ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:56.662915 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ebe0fe6-285a-4af8-b3ce-f2159e1f08ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:56.663717 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ebe0fe6-285a-4af8-b3ce-f2159e1f08ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:56.664158 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9ebe0fe6-285a-4af8-b3ce-f2159e1f08ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:56.723963 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9ebe0fe6-285a-4af8-b3ce-f2159e1f08ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:56.732194 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9ebe0fe6-285a-4af8-b3ce-f2159e1f08ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079884 Jul 19 09:47:56.732765 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 909/1846] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:56 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:57.748341 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3283aa5e-064e-4b49-b58e-aaeb95700852 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:57.748951 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3283aa5e-064e-4b49-b58e-aaeb95700852 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:57.754617 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3283aa5e-064e-4b49-b58e-aaeb95700852 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:57.755087 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3283aa5e-064e-4b49-b58e-aaeb95700852 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:57.755842 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3283aa5e-064e-4b49-b58e-aaeb95700852 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:57.756270 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3283aa5e-064e-4b49-b58e-aaeb95700852 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:57.815345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3283aa5e-064e-4b49-b58e-aaeb95700852 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:57.823226 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3283aa5e-064e-4b49-b58e-aaeb95700852 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078013 Jul 19 09:47:57.823778 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 938/1847] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:57 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:58.839870 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c2ee572f-d8e8-485c-9f7c-563a132e1dfa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:58.840480 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c2ee572f-d8e8-485c-9f7c-563a132e1dfa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:58.846267 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c2ee572f-d8e8-485c-9f7c-563a132e1dfa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:58.846713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c2ee572f-d8e8-485c-9f7c-563a132e1dfa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:58.847493 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c2ee572f-d8e8-485c-9f7c-563a132e1dfa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:58.847926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c2ee572f-d8e8-485c-9f7c-563a132e1dfa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:58.910273 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c2ee572f-d8e8-485c-9f7c-563a132e1dfa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:47:58.918763 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c2ee572f-d8e8-485c-9f7c-563a132e1dfa tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.083061 Jul 19 09:47:58.919353 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 910/1848] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:58 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:47:59.935540 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e07af762-46e1-4917-a1a5-f5bfc9d19265 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:47:59.936153 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e07af762-46e1-4917-a1a5-f5bfc9d19265 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:47:59.941929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e07af762-46e1-4917-a1a5-f5bfc9d19265 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:59.942379 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e07af762-46e1-4917-a1a5-f5bfc9d19265 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:47:59.943167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e07af762-46e1-4917-a1a5-f5bfc9d19265 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:47:59.943604 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e07af762-46e1-4917-a1a5-f5bfc9d19265 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:00.002029 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e07af762-46e1-4917-a1a5-f5bfc9d19265 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:00.009622 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e07af762-46e1-4917-a1a5-f5bfc9d19265 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078427 Jul 19 09:48:00.010176 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 939/1849] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:47:59 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:01.026114 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-591a2665-97d1-465f-a137-56a165a41e2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:01.026730 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-591a2665-97d1-465f-a137-56a165a41e2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:01.032541 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-591a2665-97d1-465f-a137-56a165a41e2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:01.032991 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-591a2665-97d1-465f-a137-56a165a41e2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:01.033757 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-591a2665-97d1-465f-a137-56a165a41e2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:01.034197 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-591a2665-97d1-465f-a137-56a165a41e2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:01.093761 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-591a2665-97d1-465f-a137-56a165a41e2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:01.101360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-591a2665-97d1-465f-a137-56a165a41e2b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078932 Jul 19 09:48:01.101921 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 911/1850] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:01 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:02.117432 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4880d37e-be0c-4bc7-b340-fc15066abfea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:02.118037 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4880d37e-be0c-4bc7-b340-fc15066abfea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:02.123884 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4880d37e-be0c-4bc7-b340-fc15066abfea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:02.124337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4880d37e-be0c-4bc7-b340-fc15066abfea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:02.125085 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4880d37e-be0c-4bc7-b340-fc15066abfea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:02.125514 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4880d37e-be0c-4bc7-b340-fc15066abfea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:02.186978 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4880d37e-be0c-4bc7-b340-fc15066abfea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:02.194910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4880d37e-be0c-4bc7-b340-fc15066abfea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.081102 Jul 19 09:48:02.195484 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 940/1851] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:02 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:03.211609 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1ddaebd9-76a1-4f17-8e50-bd3c8d9b09c6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:03.212231 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1ddaebd9-76a1-4f17-8e50-bd3c8d9b09c6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:03.218524 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1ddaebd9-76a1-4f17-8e50-bd3c8d9b09c6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:03.218979 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1ddaebd9-76a1-4f17-8e50-bd3c8d9b09c6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:03.219784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1ddaebd9-76a1-4f17-8e50-bd3c8d9b09c6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:03.220227 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1ddaebd9-76a1-4f17-8e50-bd3c8d9b09c6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:03.279577 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1ddaebd9-76a1-4f17-8e50-bd3c8d9b09c6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:03.287117 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1ddaebd9-76a1-4f17-8e50-bd3c8d9b09c6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079150 Jul 19 09:48:03.287677 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 912/1852] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:03 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:04.303871 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f23832ba-d2b4-45a1-bb95-9b6fda84d920 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:04.304480 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f23832ba-d2b4-45a1-bb95-9b6fda84d920 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:04.310299 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f23832ba-d2b4-45a1-bb95-9b6fda84d920 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:04.310778 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f23832ba-d2b4-45a1-bb95-9b6fda84d920 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:04.311561 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f23832ba-d2b4-45a1-bb95-9b6fda84d920 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:04.311994 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f23832ba-d2b4-45a1-bb95-9b6fda84d920 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:04.373187 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f23832ba-d2b4-45a1-bb95-9b6fda84d920 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:04.380775 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f23832ba-d2b4-45a1-bb95-9b6fda84d920 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080586 Jul 19 09:48:04.381334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 941/1853] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:04 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:05.397462 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3cae4729-86eb-4678-94d2-cbfcb402ec82 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:05.398067 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3cae4729-86eb-4678-94d2-cbfcb402ec82 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:05.404534 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3cae4729-86eb-4678-94d2-cbfcb402ec82 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:05.404985 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3cae4729-86eb-4678-94d2-cbfcb402ec82 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:05.405775 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3cae4729-86eb-4678-94d2-cbfcb402ec82 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:05.406209 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3cae4729-86eb-4678-94d2-cbfcb402ec82 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:05.465456 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3cae4729-86eb-4678-94d2-cbfcb402ec82 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:05.473081 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3cae4729-86eb-4678-94d2-cbfcb402ec82 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079297 Jul 19 09:48:05.473644 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 913/1854] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:05 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:06.489404 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-eff8e33d-adbf-41d9-bf6c-867822fc520b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:06.490012 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-eff8e33d-adbf-41d9-bf6c-867822fc520b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:06.496417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eff8e33d-adbf-41d9-bf6c-867822fc520b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:06.496865 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eff8e33d-adbf-41d9-bf6c-867822fc520b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:06.497629 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eff8e33d-adbf-41d9-bf6c-867822fc520b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:06.498055 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-eff8e33d-adbf-41d9-bf6c-867822fc520b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:06.558774 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-eff8e33d-adbf-41d9-bf6c-867822fc520b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:06.568079 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-eff8e33d-adbf-41d9-bf6c-867822fc520b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.082255 Jul 19 09:48:06.568943 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 942/1855] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:06 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:07.583790 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6c56fddb-6cff-47ce-b553-9998f907b9d7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:07.584396 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6c56fddb-6cff-47ce-b553-9998f907b9d7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:07.590321 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6c56fddb-6cff-47ce-b553-9998f907b9d7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:07.590891 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6c56fddb-6cff-47ce-b553-9998f907b9d7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:07.591727 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6c56fddb-6cff-47ce-b553-9998f907b9d7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:07.592187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6c56fddb-6cff-47ce-b553-9998f907b9d7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:07.656187 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6c56fddb-6cff-47ce-b553-9998f907b9d7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:07.664074 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6c56fddb-6cff-47ce-b553-9998f907b9d7 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.084080 Jul 19 09:48:07.664635 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 914/1856] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:07 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:08.680336 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a0584160-4ffd-4741-b9da-43f7435eba62 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:08.680963 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a0584160-4ffd-4741-b9da-43f7435eba62 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:08.686660 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a0584160-4ffd-4741-b9da-43f7435eba62 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:08.687150 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a0584160-4ffd-4741-b9da-43f7435eba62 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:08.687903 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a0584160-4ffd-4741-b9da-43f7435eba62 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:08.688331 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a0584160-4ffd-4741-b9da-43f7435eba62 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:08.747412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a0584160-4ffd-4741-b9da-43f7435eba62 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:08.754816 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a0584160-4ffd-4741-b9da-43f7435eba62 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078022 Jul 19 09:48:08.755400 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 943/1857] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:08 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:09.770755 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-9fe147ee-e017-4756-befd-7224dd45a556 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:09.771390 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-9fe147ee-e017-4756-befd-7224dd45a556 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:09.777069 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9fe147ee-e017-4756-befd-7224dd45a556 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:09.777517 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9fe147ee-e017-4756-befd-7224dd45a556 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:09.778795 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9fe147ee-e017-4756-befd-7224dd45a556 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:09.779272 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-9fe147ee-e017-4756-befd-7224dd45a556 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:09.838293 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-9fe147ee-e017-4756-befd-7224dd45a556 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:09.846365 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-9fe147ee-e017-4756-befd-7224dd45a556 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079208 Jul 19 09:48:09.846917 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 915/1858] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:09 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:10.862337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-855179de-447a-4434-af90-c27913c2c0dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:10.862937 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-855179de-447a-4434-af90-c27913c2c0dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:10.868731 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-855179de-447a-4434-af90-c27913c2c0dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:10.869176 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-855179de-447a-4434-af90-c27913c2c0dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:10.869927 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-855179de-447a-4434-af90-c27913c2c0dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:10.870355 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-855179de-447a-4434-af90-c27913c2c0dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:10.930129 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-855179de-447a-4434-af90-c27913c2c0dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:10.938680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-855179de-447a-4434-af90-c27913c2c0dd tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079951 Jul 19 09:48:10.939261 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 944/1859] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:10 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:11.955308 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7ab56c74-bad1-49ee-b762-9acd31d3783a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:11.955922 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7ab56c74-bad1-49ee-b762-9acd31d3783a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:11.961726 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ab56c74-bad1-49ee-b762-9acd31d3783a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:11.962182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ab56c74-bad1-49ee-b762-9acd31d3783a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:11.962951 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ab56c74-bad1-49ee-b762-9acd31d3783a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:11.963414 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7ab56c74-bad1-49ee-b762-9acd31d3783a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:12.025748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-7ab56c74-bad1-49ee-b762-9acd31d3783a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:12.034268 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7ab56c74-bad1-49ee-b762-9acd31d3783a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.082576 Jul 19 09:48:12.034920 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 916/1860] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:11 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:13.050818 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b9574c40-6f9c-46a2-8d8f-97060b4d91ea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:13.051497 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b9574c40-6f9c-46a2-8d8f-97060b4d91ea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:13.057432 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9574c40-6f9c-46a2-8d8f-97060b4d91ea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:13.057721 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9574c40-6f9c-46a2-8d8f-97060b4d91ea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:13.058411 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9574c40-6f9c-46a2-8d8f-97060b4d91ea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:13.058846 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b9574c40-6f9c-46a2-8d8f-97060b4d91ea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:13.125487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b9574c40-6f9c-46a2-8d8f-97060b4d91ea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:13.132971 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b9574c40-6f9c-46a2-8d8f-97060b4d91ea tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.085796 Jul 19 09:48:13.133541 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 945/1861] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:13 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:14.149323 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-93a380dd-63c9-4b8e-85af-194655c56ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:14.150005 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-93a380dd-63c9-4b8e-85af-194655c56ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:14.156166 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93a380dd-63c9-4b8e-85af-194655c56ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:14.156622 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93a380dd-63c9-4b8e-85af-194655c56ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:14.157398 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93a380dd-63c9-4b8e-85af-194655c56ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:14.157838 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-93a380dd-63c9-4b8e-85af-194655c56ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:14.218634 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-93a380dd-63c9-4b8e-85af-194655c56ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:14.226173 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-93a380dd-63c9-4b8e-85af-194655c56ad4 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080527 Jul 19 09:48:14.226724 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 917/1862] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:14 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:15.242550 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6b38ae1c-4e93-4772-80a9-c207c4214e2a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:15.243285 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6b38ae1c-4e93-4772-80a9-c207c4214e2a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:15.249020 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6b38ae1c-4e93-4772-80a9-c207c4214e2a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:15.249469 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6b38ae1c-4e93-4772-80a9-c207c4214e2a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:15.250232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6b38ae1c-4e93-4772-80a9-c207c4214e2a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:15.250663 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6b38ae1c-4e93-4772-80a9-c207c4214e2a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:15.309684 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6b38ae1c-4e93-4772-80a9-c207c4214e2a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:15.317194 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6b38ae1c-4e93-4772-80a9-c207c4214e2a tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078243 Jul 19 09:48:15.317752 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 946/1863] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:15 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:16.333332 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a52c0016-96a1-42fd-add5-262748ba8524 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:16.333938 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a52c0016-96a1-42fd-add5-262748ba8524 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:16.339703 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a52c0016-96a1-42fd-add5-262748ba8524 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:16.340159 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a52c0016-96a1-42fd-add5-262748ba8524 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:16.340922 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a52c0016-96a1-42fd-add5-262748ba8524 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:16.341360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a52c0016-96a1-42fd-add5-262748ba8524 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:16.403361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a52c0016-96a1-42fd-add5-262748ba8524 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:16.411084 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a52c0016-96a1-42fd-add5-262748ba8524 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.081343 Jul 19 09:48:16.411653 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 918/1864] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:16 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:17.427305 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b92e6d53-d572-4ff7-88c0-1dc21d88cc41 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:17.427919 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b92e6d53-d572-4ff7-88c0-1dc21d88cc41 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:17.433624 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b92e6d53-d572-4ff7-88c0-1dc21d88cc41 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:17.434077 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b92e6d53-d572-4ff7-88c0-1dc21d88cc41 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:17.434840 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b92e6d53-d572-4ff7-88c0-1dc21d88cc41 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:17.436049 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b92e6d53-d572-4ff7-88c0-1dc21d88cc41 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:17.494624 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b92e6d53-d572-4ff7-88c0-1dc21d88cc41 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:17.502977 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b92e6d53-d572-4ff7-88c0-1dc21d88cc41 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079349 Jul 19 09:48:17.503568 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 947/1865] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:17 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:18.525865 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-29d615f4-60ea-4894-90ca-3e114884695b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:18.525865 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-29d615f4-60ea-4894-90ca-3e114884695b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:18.526436 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-29d615f4-60ea-4894-90ca-3e114884695b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:18.526614 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-29d615f4-60ea-4894-90ca-3e114884695b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:18.527415 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-29d615f4-60ea-4894-90ca-3e114884695b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:18.527862 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-29d615f4-60ea-4894-90ca-3e114884695b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:18.589477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-29d615f4-60ea-4894-90ca-3e114884695b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:18.597296 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-29d615f4-60ea-4894-90ca-3e114884695b tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.081621 Jul 19 09:48:18.597795 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 919/1866] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:18 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:19.613220 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6191fba1-6ac5-44c9-9351-defa19010edc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:19.613842 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-6191fba1-6ac5-44c9-9351-defa19010edc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:19.619540 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6191fba1-6ac5-44c9-9351-defa19010edc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:19.619992 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6191fba1-6ac5-44c9-9351-defa19010edc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:19.620746 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6191fba1-6ac5-44c9-9351-defa19010edc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:19.621179 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-6191fba1-6ac5-44c9-9351-defa19010edc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:19.680410 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-6191fba1-6ac5-44c9-9351-defa19010edc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:19.688426 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6191fba1-6ac5-44c9-9351-defa19010edc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078782 Jul 19 09:48:19.688984 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 948/1867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:19 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:20.705190 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-db23f1b4-2488-4846-8fee-8976ec4dea8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:20.705879 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-db23f1b4-2488-4846-8fee-8976ec4dea8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:20.711676 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-db23f1b4-2488-4846-8fee-8976ec4dea8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:20.712128 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-db23f1b4-2488-4846-8fee-8976ec4dea8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:20.712898 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-db23f1b4-2488-4846-8fee-8976ec4dea8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:20.713335 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-db23f1b4-2488-4846-8fee-8976ec4dea8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:20.773527 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-db23f1b4-2488-4846-8fee-8976ec4dea8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:20.781547 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-db23f1b4-2488-4846-8fee-8976ec4dea8d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080541 Jul 19 09:48:20.782106 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 920/1868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:20 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:21.798050 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-7c84f1b4-17b1-4c6b-b0ef-b000cf4b84b6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:21.798678 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-7c84f1b4-17b1-4c6b-b0ef-b000cf4b84b6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:21.804324 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7c84f1b4-17b1-4c6b-b0ef-b000cf4b84b6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:21.804769 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7c84f1b4-17b1-4c6b-b0ef-b000cf4b84b6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:21.805520 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7c84f1b4-17b1-4c6b-b0ef-b000cf4b84b6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:21.805953 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-7c84f1b4-17b1-4c6b-b0ef-b000cf4b84b6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:21.867655 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-7c84f1b4-17b1-4c6b-b0ef-b000cf4b84b6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:21.875172 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-7c84f1b4-17b1-4c6b-b0ef-b000cf4b84b6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.081299 Jul 19 09:48:21.875670 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 949/1869] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:21 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:22.890362 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-666a7031-41fb-4973-9100-44e94de81d14 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:22.890907 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-666a7031-41fb-4973-9100-44e94de81d14 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:22.896591 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-666a7031-41fb-4973-9100-44e94de81d14 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:22.897042 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-666a7031-41fb-4973-9100-44e94de81d14 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:22.897812 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-666a7031-41fb-4973-9100-44e94de81d14 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:22.898246 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-666a7031-41fb-4973-9100-44e94de81d14 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:22.957348 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-666a7031-41fb-4973-9100-44e94de81d14 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:22.964800 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-666a7031-41fb-4973-9100-44e94de81d14 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078136 Jul 19 09:48:22.965357 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 921/1870] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:22 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:23.980092 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-44fb9035-e22a-461c-8bbc-e181eeac63ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:23.980621 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-44fb9035-e22a-461c-8bbc-e181eeac63ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:23.986900 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44fb9035-e22a-461c-8bbc-e181eeac63ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:23.987372 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44fb9035-e22a-461c-8bbc-e181eeac63ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:23.988119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44fb9035-e22a-461c-8bbc-e181eeac63ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:23.988547 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-44fb9035-e22a-461c-8bbc-e181eeac63ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:24.048995 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-44fb9035-e22a-461c-8bbc-e181eeac63ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:24.056502 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-44fb9035-e22a-461c-8bbc-e181eeac63ee tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080092 Jul 19 09:48:24.057059 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 950/1871] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:23 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:48:25.072872 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3c3cc220-46dd-46e6-8e10-b56aef6acfdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:25.073476 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3c3cc220-46dd-46e6-8e10-b56aef6acfdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:25.079840 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3c3cc220-46dd-46e6-8e10-b56aef6acfdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:25.080286 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3c3cc220-46dd-46e6-8e10-b56aef6acfdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:25.081037 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3c3cc220-46dd-46e6-8e10-b56aef6acfdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:25.081467 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3c3cc220-46dd-46e6-8e10-b56aef6acfdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:25.143999 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3c3cc220-46dd-46e6-8e10-b56aef6acfdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:25.151692 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3c3cc220-46dd-46e6-8e10-b56aef6acfdc tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.082401 Jul 19 09:48:25.152186 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 922/1872] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:25 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:26.168099 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-06baea91-c983-45d4-9ab3-82fd4a8452e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:26.168729 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-06baea91-c983-45d4-9ab3-82fd4a8452e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:26.174534 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-06baea91-c983-45d4-9ab3-82fd4a8452e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:26.174981 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-06baea91-c983-45d4-9ab3-82fd4a8452e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:26.175766 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-06baea91-c983-45d4-9ab3-82fd4a8452e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:26.176196 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-06baea91-c983-45d4-9ab3-82fd4a8452e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:26.234918 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-06baea91-c983-45d4-9ab3-82fd4a8452e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:26.242330 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-06baea91-c983-45d4-9ab3-82fd4a8452e6 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078127 Jul 19 09:48:26.242901 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 951/1873] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:26 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:27.258940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3630b024-1549-45c1-8a47-63a3194ace25 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:27.259596 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3630b024-1549-45c1-8a47-63a3194ace25 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:27.265377 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3630b024-1549-45c1-8a47-63a3194ace25 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:27.265904 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3630b024-1549-45c1-8a47-63a3194ace25 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:27.266663 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3630b024-1549-45c1-8a47-63a3194ace25 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:27.267115 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3630b024-1549-45c1-8a47-63a3194ace25 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:27.326331 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3630b024-1549-45c1-8a47-63a3194ace25 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:27.333903 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3630b024-1549-45c1-8a47-63a3194ace25 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.078613 Jul 19 09:48:27.334457 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 923/1874] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:27 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:28.350395 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-33ee7407-f880-4fb8-a07f-16fe51084a10 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:28.351004 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-33ee7407-f880-4fb8-a07f-16fe51084a10 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:28.356800 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33ee7407-f880-4fb8-a07f-16fe51084a10 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:28.357250 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33ee7407-f880-4fb8-a07f-16fe51084a10 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:28.358552 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33ee7407-f880-4fb8-a07f-16fe51084a10 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:28.359008 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-33ee7407-f880-4fb8-a07f-16fe51084a10 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:28.418407 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-33ee7407-f880-4fb8-a07f-16fe51084a10 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:28.426489 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-33ee7407-f880-4fb8-a07f-16fe51084a10 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079817 Jul 19 09:48:28.427051 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 952/1875] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:28 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:29.442939 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d23e20f8-af7a-4233-ba57-420130b95a45 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:29.443579 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d23e20f8-af7a-4233-ba57-420130b95a45 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:29.449409 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d23e20f8-af7a-4233-ba57-420130b95a45 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:29.449853 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d23e20f8-af7a-4233-ba57-420130b95a45 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:29.450612 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d23e20f8-af7a-4233-ba57-420130b95a45 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:29.451055 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d23e20f8-af7a-4233-ba57-420130b95a45 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:29.510458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-d23e20f8-af7a-4233-ba57-420130b95a45 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:29.518732 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d23e20f8-af7a-4233-ba57-420130b95a45 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079451 Jul 19 09:48:29.519337 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 924/1876] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:29 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:48:30.535628 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-66dbac17-a3cd-4ec8-a41b-4b3e26ebdbed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:30.536246 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-66dbac17-a3cd-4ec8-a41b-4b3e26ebdbed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:30.542443 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-66dbac17-a3cd-4ec8-a41b-4b3e26ebdbed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:30.542890 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-66dbac17-a3cd-4ec8-a41b-4b3e26ebdbed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:30.543681 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-66dbac17-a3cd-4ec8-a41b-4b3e26ebdbed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:30.544125 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-66dbac17-a3cd-4ec8-a41b-4b3e26ebdbed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:30.605953 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-66dbac17-a3cd-4ec8-a41b-4b3e26ebdbed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:30.613511 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-66dbac17-a3cd-4ec8-a41b-4b3e26ebdbed tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.081562 Jul 19 09:48:30.614075 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 953/1877] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:30 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:31.629849 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b1ece7f5-13cf-48d5-b983-00815b1c4075 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:31.630473 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b1ece7f5-13cf-48d5-b983-00815b1c4075 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:31.636137 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1ece7f5-13cf-48d5-b983-00815b1c4075 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:31.636581 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1ece7f5-13cf-48d5-b983-00815b1c4075 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:31.637360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1ece7f5-13cf-48d5-b983-00815b1c4075 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:31.637790 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b1ece7f5-13cf-48d5-b983-00815b1c4075 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:31.696559 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b1ece7f5-13cf-48d5-b983-00815b1c4075 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:31.704095 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b1ece7f5-13cf-48d5-b983-00815b1c4075 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.077948 Jul 19 09:48:31.704645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 925/1878] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:31 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:32.720248 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a271d2ed-bd42-4049-8711-77dc3d09d281 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:32.720852 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a271d2ed-bd42-4049-8711-77dc3d09d281 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:32.726592 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a271d2ed-bd42-4049-8711-77dc3d09d281 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:32.727059 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a271d2ed-bd42-4049-8711-77dc3d09d281 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:32.727821 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a271d2ed-bd42-4049-8711-77dc3d09d281 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:32.728231 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a271d2ed-bd42-4049-8711-77dc3d09d281 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:32.788104 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a271d2ed-bd42-4049-8711-77dc3d09d281 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:32.796708 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a271d2ed-bd42-4049-8711-77dc3d09d281 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080185 Jul 19 09:48:32.797339 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 954/1879] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:32 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:33.812894 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a811b0bd-82b7-487a-a8a1-4a40d20de984 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:33.813523 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a811b0bd-82b7-487a-a8a1-4a40d20de984 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:33.819293 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a811b0bd-82b7-487a-a8a1-4a40d20de984 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:33.819738 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a811b0bd-82b7-487a-a8a1-4a40d20de984 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:33.820490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a811b0bd-82b7-487a-a8a1-4a40d20de984 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:33.820921 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a811b0bd-82b7-487a-a8a1-4a40d20de984 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:33.884917 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a811b0bd-82b7-487a-a8a1-4a40d20de984 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:33.892703 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a811b0bd-82b7-487a-a8a1-4a40d20de984 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.083555 Jul 19 09:48:33.893250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 926/1880] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:33 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:34.909446 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a262f6db-29d3-4c4e-8f63-2ebea8e69412 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:34.910049 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a262f6db-29d3-4c4e-8f63-2ebea8e69412 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:34.915957 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a262f6db-29d3-4c4e-8f63-2ebea8e69412 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:34.916618 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a262f6db-29d3-4c4e-8f63-2ebea8e69412 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:34.917766 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a262f6db-29d3-4c4e-8f63-2ebea8e69412 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:34.918468 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a262f6db-29d3-4c4e-8f63-2ebea8e69412 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:34.978102 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a262f6db-29d3-4c4e-8f63-2ebea8e69412 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:34.985520 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a262f6db-29d3-4c4e-8f63-2ebea8e69412 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080478 Jul 19 09:48:34.986069 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 955/1881] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:34 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:36.001965 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8c0c59d9-71c8-4aa8-a497-018ca0b6f317 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:36.002567 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8c0c59d9-71c8-4aa8-a497-018ca0b6f317 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:36.008572 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8c0c59d9-71c8-4aa8-a497-018ca0b6f317 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:36.009017 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8c0c59d9-71c8-4aa8-a497-018ca0b6f317 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:36.009797 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8c0c59d9-71c8-4aa8-a497-018ca0b6f317 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:36.010229 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8c0c59d9-71c8-4aa8-a497-018ca0b6f317 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:36.070543 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8c0c59d9-71c8-4aa8-a497-018ca0b6f317 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:36.078827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8c0c59d9-71c8-4aa8-a497-018ca0b6f317 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.081018 Jul 19 09:48:36.079421 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 927/1882] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:35 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:37.095267 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-937fe8c0-4bc5-4a80-813f-7c1ae627fe88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:37.095872 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-937fe8c0-4bc5-4a80-813f-7c1ae627fe88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:37.101657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-937fe8c0-4bc5-4a80-813f-7c1ae627fe88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:37.102084 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-937fe8c0-4bc5-4a80-813f-7c1ae627fe88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:37.102831 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-937fe8c0-4bc5-4a80-813f-7c1ae627fe88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:37.103290 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-937fe8c0-4bc5-4a80-813f-7c1ae627fe88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:37.163095 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-937fe8c0-4bc5-4a80-813f-7c1ae627fe88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:37.171317 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-937fe8c0-4bc5-4a80-813f-7c1ae627fe88 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079998 Jul 19 09:48:37.171817 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 956/1883] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:37 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:38.188475 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-559d39e5-5dd9-43d1-87dc-883025c42275 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:38.189122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-559d39e5-5dd9-43d1-87dc-883025c42275 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:38.195143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-559d39e5-5dd9-43d1-87dc-883025c42275 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:38.195595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-559d39e5-5dd9-43d1-87dc-883025c42275 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:38.196359 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-559d39e5-5dd9-43d1-87dc-883025c42275 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:38.196795 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-559d39e5-5dd9-43d1-87dc-883025c42275 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:38.256237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-559d39e5-5dd9-43d1-87dc-883025c42275 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:38.263823 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-559d39e5-5dd9-43d1-87dc-883025c42275 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.079663 Jul 19 09:48:38.264374 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 928/1884] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:38 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:39.278829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d1c6d97e-098f-4452-8db7-e8d34fccf9d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:39.279463 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d1c6d97e-098f-4452-8db7-e8d34fccf9d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:39.285271 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d1c6d97e-098f-4452-8db7-e8d34fccf9d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:39.285721 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d1c6d97e-098f-4452-8db7-e8d34fccf9d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:39.286479 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d1c6d97e-098f-4452-8db7-e8d34fccf9d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:39.286908 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d1c6d97e-098f-4452-8db7-e8d34fccf9d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:39.348612 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d1c6d97e-098f-4452-8db7-e8d34fccf9d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea32acab08a4c08a4ef939d0617f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5dc0db33db416288959a941e0d4d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:48:39.356231 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d1c6d97e-098f-4452-8db7-e8d34fccf9d3 tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 200 len: 1353 microversion: 2.1 time: 0.080999 Jul 19 09:48:39.356791 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 957/1885] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:39 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:48:40.373170 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c7b80f61-77e0-4d78-ab21-0a8deb390f9d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:48:40.373823 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c7b80f61-77e0-4d78-ab21-0a8deb390f9d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] [instance: 0ee4430d-0d5f-45bd-848e-aa6f05870b67] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:48:40.379560 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7b80f61-77e0-4d78-ab21-0a8deb390f9d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:40.380015 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7b80f61-77e0-4d78-ab21-0a8deb390f9d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:40.380779 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7b80f61-77e0-4d78-ab21-0a8deb390f9d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:48:40.381219 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c7b80f61-77e0-4d78-ab21-0a8deb390f9d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:48:40.394715 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-c7b80f61-77e0-4d78-ab21-0a8deb390f9d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] HTTP exception thrown: Instance 0ee4430d-0d5f-45bd-848e-aa6f05870b67 could not be found. Jul 19 09:48:40.395327 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c7b80f61-77e0-4d78-ab21-0a8deb390f9d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] Returning 404 to user: Instance 0ee4430d-0d5f-45bd-848e-aa6f05870b67 could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:48:40.396135 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c7b80f61-77e0-4d78-ab21-0a8deb390f9d tempest-ServerRescueNegativeTestJSON-2138497825 tempest-ServerRescueNegativeTestJSON-2138497825-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67" status: 404 len: 111 microversion: 2.1 time: 0.026720 Jul 19 09:48:40.396642 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 929/1886] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:48:40 2021] GET /compute/v2.1/servers/0ee4430d-0d5f-45bd-848e-aa6f05870b67 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:48:48.718333 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:48:48.718838 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:48:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:48:52.863242 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:48:52.863861 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:48:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:48:57.239573 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:48:57.240139 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:48:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:49:05.959522 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f2b5775e-9fb5-4de1-b106-11a29dec6c78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:49:05.960120 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f2b5775e-9fb5-4de1-b106-11a29dec6c78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:49:05.965657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2b5775e-9fb5-4de1-b106-11a29dec6c78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:49:05.966098 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2b5775e-9fb5-4de1-b106-11a29dec6c78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:49:05.967448 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2b5775e-9fb5-4de1-b106-11a29dec6c78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:49:05.967873 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f2b5775e-9fb5-4de1-b106-11a29dec6c78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:49:05.980689 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-f2b5775e-9fb5-4de1-b106-11a29dec6c78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] HTTP exception thrown: Instance 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 could not be found. Jul 19 09:49:05.981259 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f2b5775e-9fb5-4de1-b106-11a29dec6c78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Returning 404 to user: Instance 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:49:05.982078 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f2b5775e-9fb5-4de1-b106-11a29dec6c78 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99" status: 404 len: 111 microversion: 2.1 time: 0.026189 Jul 19 09:49:05.982571 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 958/1887] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:49:05 2021] DELETE /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:49:05.990085 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-de9e97fa-ed40-4cc2-86ef-717589af7d80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:49:05.991016 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-de9e97fa-ed40-4cc2-86ef-717589af7d80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:49:05.996815 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-de9e97fa-ed40-4cc2-86ef-717589af7d80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:49:05.997259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-de9e97fa-ed40-4cc2-86ef-717589af7d80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:49:05.998690 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-de9e97fa-ed40-4cc2-86ef-717589af7d80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:49:05.999158 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-de9e97fa-ed40-4cc2-86ef-717589af7d80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:49:06.012661 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-de9e97fa-ed40-4cc2-86ef-717589af7d80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] HTTP exception thrown: Instance 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 could not be found. Jul 19 09:49:06.013287 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-de9e97fa-ed40-4cc2-86ef-717589af7d80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Returning 404 to user: Instance 4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:49:06.014604 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-de9e97fa-ed40-4cc2-86ef-717589af7d80 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99" status: 404 len: 111 microversion: 2.1 time: 0.028168 Jul 19 09:49:06.015141 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 930/1888] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:49:05 2021] GET /compute/v2.1/servers/4dc900d8-8c3c-429b-953a-e2bcb0ef6d99 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:49:06.339710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:49:06.339883 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:49:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:49:54.158719 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 19 09:49:54.162036 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e57dce00-4239-4337-a639-8b4cc8b1b5fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:49:54.162525 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e57dce00-4239-4337-a639-8b4cc8b1b5fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:49:54.170345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e57dce00-4239-4337-a639-8b4cc8b1b5fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:49:54.170799 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e57dce00-4239-4337-a639-8b4cc8b1b5fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:49:54.171595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e57dce00-4239-4337-a639-8b4cc8b1b5fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:49:54.172029 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e57dce00-4239-4337-a639-8b4cc8b1b5fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:49:54.196223 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e57dce00-4239-4337-a639-8b4cc8b1b5fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Going to try to terminate instance {{(pid=107463) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:49:54.268100 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e57dce00-4239-4337-a639-8b4cc8b1b5fd tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca" status: 204 len: 0 microversion: 2.1 time: 0.110168 Jul 19 09:49:54.268958 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 959/1889] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:49:54 2021] DELETE /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 09:49:54.278729 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a5e93605-8837-40bf-a189-8df49666a20f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:49:54.279368 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a5e93605-8837-40bf-a189-8df49666a20f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:49:54.282243 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 09:49:54.286731 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a5e93605-8837-40bf-a189-8df49666a20f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:49:54.287233 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a5e93605-8837-40bf-a189-8df49666a20f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:49:54.287992 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a5e93605-8837-40bf-a189-8df49666a20f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:49:54.288423 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a5e93605-8837-40bf-a189-8df49666a20f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:49:54.420814 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a5e93605-8837-40bf-a189-8df49666a20f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:49:54.428013 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a5e93605-8837-40bf-a189-8df49666a20f tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca" status: 200 len: 1674 microversion: 2.1 time: 0.153408 Jul 19 09:49:54.428563 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 931/1890] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:49:54 2021] GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:49:55.445929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-09132cd2-f254-4681-a272-73d63eed1555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:49:55.446627 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-09132cd2-f254-4681-a272-73d63eed1555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:49:55.463876 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09132cd2-f254-4681-a272-73d63eed1555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:49:55.464639 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09132cd2-f254-4681-a272-73d63eed1555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:49:55.465480 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09132cd2-f254-4681-a272-73d63eed1555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:49:55.465939 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-09132cd2-f254-4681-a272-73d63eed1555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:49:55.471774 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 35876. Jul 19 09:49:55.533886 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-09132cd2-f254-4681-a272-73d63eed1555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e227950a67d49a1a7e9a5cc85c3b7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e21ba608b3d4e3fb2142888e5ad882b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:49:55.541311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-09132cd2-f254-4681-a272-73d63eed1555 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca" status: 200 len: 1606 microversion: 2.1 time: 0.099320 Jul 19 09:49:55.541881 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 960/1891] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:49:55 2021] GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca => generated 1606 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:49:55.794054 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-2828be9f-c1c6-4630-8fc9-a0014e568de5 req-211e2f2e-a9d8-4439-9658-30aa0c5a6c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf3558d-149c-40e0-89da-b6def3a230ca", "name": "network-vif-deleted", "tag": "63be8dfd-ab36-43a2-9cef-0376d44fd1f5"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:49:55.795743 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:49:55.795743 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:49:55.815582 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-2828be9f-c1c6-4630-8fc9-a0014e568de5 req-211e2f2e-a9d8-4439-9658-30aa0c5a6c54 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:49:55.816047 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-2828be9f-c1c6-4630-8fc9-a0014e568de5 req-211e2f2e-a9d8-4439-9658-30aa0c5a6c54 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:49:55.828506 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-2828be9f-c1c6-4630-8fc9-a0014e568de5 req-211e2f2e-a9d8-4439-9658-30aa0c5a6c54 service nova] Creating event network-vif-deleted:63be8dfd-ab36-43a2-9cef-0376d44fd1f5 for instance 7cf3558d-149c-40e0-89da-b6def3a230ca on hv-cinder-79338 Jul 19 09:49:55.831927 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 35882. Jul 19 09:49:55.835410 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-2828be9f-c1c6-4630-8fc9-a0014e568de5 req-211e2f2e-a9d8-4439-9658-30aa0c5a6c54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045219 Jul 19 09:49:55.835994 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 932/1892] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:49:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:49:56.557531 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-008fd7c4-37c7-4a52-961c-3ebc051b1188 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:49:56.558177 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-008fd7c4-37c7-4a52-961c-3ebc051b1188 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:49:56.564970 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-008fd7c4-37c7-4a52-961c-3ebc051b1188 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:49:56.565411 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-008fd7c4-37c7-4a52-961c-3ebc051b1188 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:49:56.566177 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-008fd7c4-37c7-4a52-961c-3ebc051b1188 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:49:56.566622 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-008fd7c4-37c7-4a52-961c-3ebc051b1188 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:49:56.580166 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-008fd7c4-37c7-4a52-961c-3ebc051b1188 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] HTTP exception thrown: Instance 7cf3558d-149c-40e0-89da-b6def3a230ca could not be found. Jul 19 09:49:56.580887 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-008fd7c4-37c7-4a52-961c-3ebc051b1188 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Returning 404 to user: Instance 7cf3558d-149c-40e0-89da-b6def3a230ca could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:49:56.581743 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-008fd7c4-37c7-4a52-961c-3ebc051b1188 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca" status: 404 len: 111 microversion: 2.1 time: 0.027967 Jul 19 09:49:56.582287 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 961/1893] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:49:56 2021] GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:49:56.590789 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f59285da-d9ae-41e0-b39c-963038903768 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '.version_select at 0x7f04b01013a0>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:49:56.612924 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f59285da-d9ae-41e0-b39c-963038903768 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988494871" status: 202 len: 0 microversion: 2.1 time: 0.025923 Jul 19 09:49:56.613502 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 933/1894] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Jul 19 09:49:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988494871 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:50:15.244289 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:50:15.244918 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:50:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:50:20.382829 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-db3ed8d8-f91c-4c53-8f78-461140b0ce05 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:50:20.383351 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-db3ed8d8-f91c-4c53-8f78-461140b0ce05 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:50:20.389481 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-db3ed8d8-f91c-4c53-8f78-461140b0ce05 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:20.389945 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-db3ed8d8-f91c-4c53-8f78-461140b0ce05 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:20.390699 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-db3ed8d8-f91c-4c53-8f78-461140b0ce05 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:20.391154 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-db3ed8d8-f91c-4c53-8f78-461140b0ce05 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:20.414825 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-db3ed8d8-f91c-4c53-8f78-461140b0ce05 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Going to try to terminate instance {{(pid=107463) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:50:20.493495 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-db3ed8d8-f91c-4c53-8f78-461140b0ce05 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "DELETE /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 204 len: 0 microversion: 2.1 time: 0.113965 Jul 19 09:50:20.494317 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 962/1895] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:50:20 2021] DELETE /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 09:50:20.502534 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-72d3fc2e-1227-4894-bbfe-37024e3c4c94 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:50:20.503364 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-72d3fc2e-1227-4894-bbfe-37024e3c4c94 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:50:20.509519 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72d3fc2e-1227-4894-bbfe-37024e3c4c94 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:20.509895 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72d3fc2e-1227-4894-bbfe-37024e3c4c94 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:20.510657 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72d3fc2e-1227-4894-bbfe-37024e3c4c94 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:20.511121 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-72d3fc2e-1227-4894-bbfe-37024e3c4c94 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:20.651069 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-72d3fc2e-1227-4894-bbfe-37024e3c4c94 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:50:20.659950 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-72d3fc2e-1227-4894-bbfe-37024e3c4c94 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1512 microversion: 2.1 time: 0.161413 Jul 19 09:50:20.660737 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 934/1896] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:50:20 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:50:21.382227 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-10c6caf4-542e-428a-af6b-73ab7f38a205 req-43ac9004-3b08-4eef-a951-ccb53677a2ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "249757f0-2b91-4c45-b523-d9514051420c", "name": "network-vif-deleted", "tag": "af17d36c-1a1f-47d3-bece-1254af6bef7d"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:50:21.383806 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:50:21.383806 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:50:21.392628 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-10c6caf4-542e-428a-af6b-73ab7f38a205 req-43ac9004-3b08-4eef-a951-ccb53677a2ba service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:21.393069 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-10c6caf4-542e-428a-af6b-73ab7f38a205 req-43ac9004-3b08-4eef-a951-ccb53677a2ba service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:21.404750 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-10c6caf4-542e-428a-af6b-73ab7f38a205 req-43ac9004-3b08-4eef-a951-ccb53677a2ba service nova] Creating event network-vif-deleted:af17d36c-1a1f-47d3-bece-1254af6bef7d for instance 249757f0-2b91-4c45-b523-d9514051420c on hv-cinder-79338 Jul 19 09:50:21.409723 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-10c6caf4-542e-428a-af6b-73ab7f38a205 req-43ac9004-3b08-4eef-a951-ccb53677a2ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031402 Jul 19 09:50:21.410315 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 963/1897] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:50:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:50:21.676710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e01f7bd6-a305-4d63-ba3b-b8fb900c3089 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:50:21.677322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e01f7bd6-a305-4d63-ba3b-b8fb900c3089 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:50:21.683057 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e01f7bd6-a305-4d63-ba3b-b8fb900c3089 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:21.683517 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e01f7bd6-a305-4d63-ba3b-b8fb900c3089 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:21.684284 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e01f7bd6-a305-4d63-ba3b-b8fb900c3089 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:21.684722 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e01f7bd6-a305-4d63-ba3b-b8fb900c3089 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:21.716031 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e01f7bd6-a305-4d63-ba3b-b8fb900c3089 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:21.716768 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e01f7bd6-a305-4d63-ba3b-b8fb900c3089 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:21.717610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.objects.instance [None req-e01f7bd6-a305-4d63-ba3b-b8fb900c3089 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lazy-loading 'fault' on Instance uuid 249757f0-2b91-4c45-b523-d9514051420c {{(pid=107464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:50:21.761084 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e01f7bd6-a305-4d63-ba3b-b8fb900c3089 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:50:21.769093 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e01f7bd6-a305-4d63-ba3b-b8fb900c3089 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 200 len: 1307 microversion: 2.1 time: 0.095960 Jul 19 09:50:21.769716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 935/1898] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:50:21 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:50:22.786527 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4316648a-18fc-4121-be86-cb674270d554 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:50:22.787252 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4316648a-18fc-4121-be86-cb674270d554 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 249757f0-2b91-4c45-b523-d9514051420c] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:50:22.793417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4316648a-18fc-4121-be86-cb674270d554 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:22.793868 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4316648a-18fc-4121-be86-cb674270d554 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:22.794633 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4316648a-18fc-4121-be86-cb674270d554 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:22.795091 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4316648a-18fc-4121-be86-cb674270d554 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:22.807738 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-4316648a-18fc-4121-be86-cb674270d554 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] HTTP exception thrown: Instance 249757f0-2b91-4c45-b523-d9514051420c could not be found. Jul 19 09:50:22.808323 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4316648a-18fc-4121-be86-cb674270d554 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Returning 404 to user: Instance 249757f0-2b91-4c45-b523-d9514051420c could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:50:22.809168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4316648a-18fc-4121-be86-cb674270d554 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c" status: 404 len: 111 microversion: 2.1 time: 0.026614 Jul 19 09:50:22.809703 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 964/1899] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:50:22 2021] GET /compute/v2.1/servers/249757f0-2b91-4c45-b523-d9514051420c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:50:22.818038 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-be2ee72b-2d24-40b4-9050-ba0e4ef59968 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:50:22.818562 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-be2ee72b-2d24-40b4-9050-ba0e4ef59968 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:50:22.824447 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be2ee72b-2d24-40b4-9050-ba0e4ef59968 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:22.824895 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be2ee72b-2d24-40b4-9050-ba0e4ef59968 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:22.825659 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be2ee72b-2d24-40b4-9050-ba0e4ef59968 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:22.826741 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-be2ee72b-2d24-40b4-9050-ba0e4ef59968 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:22.850469 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-be2ee72b-2d24-40b4-9050-ba0e4ef59968 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Going to try to terminate instance {{(pid=107464) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:50:22.924008 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-be2ee72b-2d24-40b4-9050-ba0e4ef59968 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "DELETE /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 204 len: 0 microversion: 2.1 time: 0.109336 Jul 19 09:50:22.924750 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 936/1900] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:50:22 2021] DELETE /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 09:50:22.933283 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-24a99fcc-25de-4842-bd85-8b40ed717c8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:50:22.933898 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-24a99fcc-25de-4842-bd85-8b40ed717c8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:50:22.940268 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-24a99fcc-25de-4842-bd85-8b40ed717c8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:22.940720 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-24a99fcc-25de-4842-bd85-8b40ed717c8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:22.941477 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-24a99fcc-25de-4842-bd85-8b40ed717c8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:22.941906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-24a99fcc-25de-4842-bd85-8b40ed717c8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:23.073799 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-24a99fcc-25de-4842-bd85-8b40ed717c8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:50:23.081615 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-24a99fcc-25de-4842-bd85-8b40ed717c8a tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 200 len: 1514 microversion: 2.1 time: 0.151980 Jul 19 09:50:23.082177 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 965/1901] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:50:22 2021] GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:50:23.792705 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-e7e5db5d-2b8c-4dc4-834c-b4f64377900d req-4559f8f5-2691-4e2e-92bb-69db3df1fd66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648", "name": "network-vif-deleted", "tag": "d9568367-e6a4-4455-8e55-2aa4ddaf098f"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:50:23.795435 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:50:23.795435 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:50:23.803566 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-e7e5db5d-2b8c-4dc4-834c-b4f64377900d req-4559f8f5-2691-4e2e-92bb-69db3df1fd66 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:23.803701 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-e7e5db5d-2b8c-4dc4-834c-b4f64377900d req-4559f8f5-2691-4e2e-92bb-69db3df1fd66 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:23.816604 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-e7e5db5d-2b8c-4dc4-834c-b4f64377900d req-4559f8f5-2691-4e2e-92bb-69db3df1fd66 service nova] Creating event network-vif-deleted:d9568367-e6a4-4455-8e55-2aa4ddaf098f for instance 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 on hv-cinder-79338 Jul 19 09:50:23.822360 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-e7e5db5d-2b8c-4dc4-834c-b4f64377900d req-4559f8f5-2691-4e2e-92bb-69db3df1fd66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033638 Jul 19 09:50:23.824074 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 937/1902] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:50:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:50:24.098517 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-93afc907-aec7-498e-8a71-9e27e45a7d2d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:50:24.099153 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-93afc907-aec7-498e-8a71-9e27e45a7d2d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:50:24.104975 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-93afc907-aec7-498e-8a71-9e27e45a7d2d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:24.105453 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-93afc907-aec7-498e-8a71-9e27e45a7d2d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:24.106215 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-93afc907-aec7-498e-8a71-9e27e45a7d2d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:24.106678 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-93afc907-aec7-498e-8a71-9e27e45a7d2d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:24.136295 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-93afc907-aec7-498e-8a71-9e27e45a7d2d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:24.136823 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-93afc907-aec7-498e-8a71-9e27e45a7d2d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:24.137484 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.objects.instance [None req-93afc907-aec7-498e-8a71-9e27e45a7d2d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lazy-loading 'fault' on Instance uuid 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 {{(pid=107463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:50:24.182024 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-93afc907-aec7-498e-8a71-9e27e45a7d2d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:50:24.189235 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-93afc907-aec7-498e-8a71-9e27e45a7d2d tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 200 len: 1308 microversion: 2.1 time: 0.094338 Jul 19 09:50:24.189801 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 966/1903] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:50:24 2021] GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:50:25.206043 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5ada441a-164a-4a04-be45-6ba22b9f6ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:50:25.206765 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5ada441a-164a-4a04-be45-6ba22b9f6ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:50:25.212817 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ada441a-164a-4a04-be45-6ba22b9f6ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:25.213264 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ada441a-164a-4a04-be45-6ba22b9f6ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:25.214015 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ada441a-164a-4a04-be45-6ba22b9f6ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:50:25.214442 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5ada441a-164a-4a04-be45-6ba22b9f6ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:50:25.227533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-5ada441a-164a-4a04-be45-6ba22b9f6ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] HTTP exception thrown: Instance 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 could not be found. Jul 19 09:50:25.228105 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5ada441a-164a-4a04-be45-6ba22b9f6ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Returning 404 to user: Instance 25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:50:25.228904 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5ada441a-164a-4a04-be45-6ba22b9f6ad4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648" status: 404 len: 111 microversion: 2.1 time: 0.026938 Jul 19 09:50:25.229403 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 938/1904] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:50:25 2021] GET /compute/v2.1/servers/25b82b1e-e00e-4e1e-a1d6-da0e1ebe9648 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:50:41.265935 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-6366c463-02b8-44f2-8992-bb72b2b634ee tempest-TestVolumeBootPattern-575772111 tempest-TestVolumeBootPattern-575772111-project] Calling method '.version_select at 0x7f04b0288700>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:50:41.294927 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-6366c463-02b8-44f2-8992-bb72b2b634ee tempest-TestVolumeBootPattern-575772111 tempest-TestVolumeBootPattern-575772111-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1217974293" status: 202 len: 0 microversion: 2.1 time: 0.033139 Jul 19 09:50:41.295581 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 967/1905] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Jul 19 09:50:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1217974293 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 09:52:14.264722 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:52:14.265258 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:52:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:52:17.256463 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:52:17.256946 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:52:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:53:35.261512 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:53:35.262038 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:53:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:53:52.884209 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:53:52.884728 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:53:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:55:06.468881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 09:55:06.472392 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7a06e1a1-203f-4416-965a-7dd754590a59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:55:06.472878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-7a06e1a1-203f-4416-965a-7dd754590a59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:55:06.479789 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7a06e1a1-203f-4416-965a-7dd754590a59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:55:06.480231 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7a06e1a1-203f-4416-965a-7dd754590a59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:55:06.480986 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7a06e1a1-203f-4416-965a-7dd754590a59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:55:06.481427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-7a06e1a1-203f-4416-965a-7dd754590a59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:55:06.493809 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-7a06e1a1-203f-4416-965a-7dd754590a59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] HTTP exception thrown: Instance 5cbcf278-5d96-4715-9238-5dd27d17311d could not be found. Jul 19 09:55:06.494375 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-7a06e1a1-203f-4416-965a-7dd754590a59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Returning 404 to user: Instance 5cbcf278-5d96-4715-9238-5dd27d17311d could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:55:06.495755 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-7a06e1a1-203f-4416-965a-7dd754590a59 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 404 len: 111 microversion: 2.1 time: 0.028699 Jul 19 09:55:06.498802 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 939/1906] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:55:06 2021] DELETE /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:55:06.501930 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 09:55:06.505536 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-fc40954b-facf-4c58-976b-0e5a3ab1ee28 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:55:06.506145 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-fc40954b-facf-4c58-976b-0e5a3ab1ee28 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] [instance: 5cbcf278-5d96-4715-9238-5dd27d17311d] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:55:06.512732 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fc40954b-facf-4c58-976b-0e5a3ab1ee28 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:55:06.513220 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fc40954b-facf-4c58-976b-0e5a3ab1ee28 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:55:06.514009 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fc40954b-facf-4c58-976b-0e5a3ab1ee28 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:55:06.514447 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fc40954b-facf-4c58-976b-0e5a3ab1ee28 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:55:06.527256 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-fc40954b-facf-4c58-976b-0e5a3ab1ee28 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] HTTP exception thrown: Instance 5cbcf278-5d96-4715-9238-5dd27d17311d could not be found. Jul 19 09:55:06.527840 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-fc40954b-facf-4c58-976b-0e5a3ab1ee28 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] Returning 404 to user: Instance 5cbcf278-5d96-4715-9238-5dd27d17311d could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:55:06.528657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-fc40954b-facf-4c58-976b-0e5a3ab1ee28 tempest-AttachVolumeShelveTestJSON-1116820464 tempest-AttachVolumeShelveTestJSON-1116820464-project] 10.222.0.16 "GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d" status: 404 len: 111 microversion: 2.1 time: 0.028609 Jul 19 09:55:06.529170 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 968/1907] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:55:06 2021] GET /compute/v2.1/servers/5cbcf278-5d96-4715-9238-5dd27d17311d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:55:28.739497 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:55:28.740119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:55:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:55:34.281207 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:55:34.281699 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:55:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:55:37.274416 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:55:37.274846 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:55:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:55:46.360853 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:55:46.361356 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:55:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:55:57.884318 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3296b044-a0bd-471e-b77d-eb2e08914605 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:55:57.884906 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3296b044-a0bd-471e-b77d-eb2e08914605 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:55:57.906299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40524. Jul 19 09:55:57.908323 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3296b044-a0bd-471e-b77d-eb2e08914605 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:55:57.908801 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3296b044-a0bd-471e-b77d-eb2e08914605 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:55:57.909573 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3296b044-a0bd-471e-b77d-eb2e08914605 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:55:57.910007 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3296b044-a0bd-471e-b77d-eb2e08914605 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:55:57.923683 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-3296b044-a0bd-471e-b77d-eb2e08914605 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] HTTP exception thrown: Instance 7cf3558d-149c-40e0-89da-b6def3a230ca could not be found. Jul 19 09:55:57.924300 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3296b044-a0bd-471e-b77d-eb2e08914605 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Returning 404 to user: Instance 7cf3558d-149c-40e0-89da-b6def3a230ca could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:55:57.925133 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3296b044-a0bd-471e-b77d-eb2e08914605 tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca" status: 404 len: 111 microversion: 2.1 time: 0.044467 Jul 19 09:55:57.925655 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 940/1908] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:55:57 2021] DELETE /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:55:57.933488 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e5746f5e-8801-4f1e-bafe-d3dd407ad48a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:55:57.934100 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e5746f5e-8801-4f1e-bafe-d3dd407ad48a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 7cf3558d-149c-40e0-89da-b6def3a230ca] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:55:57.952471 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e5746f5e-8801-4f1e-bafe-d3dd407ad48a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:55:57.952925 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e5746f5e-8801-4f1e-bafe-d3dd407ad48a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:55:57.953767 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e5746f5e-8801-4f1e-bafe-d3dd407ad48a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:55:57.954204 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e5746f5e-8801-4f1e-bafe-d3dd407ad48a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:55:57.959378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40530. Jul 19 09:55:57.969713 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-e5746f5e-8801-4f1e-bafe-d3dd407ad48a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] HTTP exception thrown: Instance 7cf3558d-149c-40e0-89da-b6def3a230ca could not be found. Jul 19 09:55:57.970312 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e5746f5e-8801-4f1e-bafe-d3dd407ad48a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Returning 404 to user: Instance 7cf3558d-149c-40e0-89da-b6def3a230ca could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:55:57.971180 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e5746f5e-8801-4f1e-bafe-d3dd407ad48a tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca" status: 404 len: 111 microversion: 2.1 time: 0.041374 Jul 19 09:55:57.971710 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 969/1909] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:55:57 2021] GET /compute/v2.1/servers/7cf3558d-149c-40e0-89da-b6def3a230ca => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 09:56:25.682307 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6b169ba2-b8a4-415a-bc65-814de93bd2df tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:56:25.682840 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6b169ba2-b8a4-415a-bc65-814de93bd2df tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:56:25.693673 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b169ba2-b8a4-415a-bc65-814de93bd2df tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:56:25.694129 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b169ba2-b8a4-415a-bc65-814de93bd2df tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:56:25.694912 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b169ba2-b8a4-415a-bc65-814de93bd2df tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:56:25.695381 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6b169ba2-b8a4-415a-bc65-814de93bd2df tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:56:25.720512 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6b169ba2-b8a4-415a-bc65-814de93bd2df tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Going to try to terminate instance {{(pid=107464) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:56:25.792902 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6b169ba2-b8a4-415a-bc65-814de93bd2df tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 204 len: 0 microversion: 2.1 time: 0.113917 Jul 19 09:56:25.793464 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 941/1910] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:56:25 2021] DELETE /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 09:56:25.801429 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d46bc05e-c26d-4b7e-b734-c0176bf9a818 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:56:25.802013 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d46bc05e-c26d-4b7e-b734-c0176bf9a818 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:56:25.808323 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d46bc05e-c26d-4b7e-b734-c0176bf9a818 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:56:25.808771 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d46bc05e-c26d-4b7e-b734-c0176bf9a818 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:56:25.809533 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d46bc05e-c26d-4b7e-b734-c0176bf9a818 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:56:25.809964 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d46bc05e-c26d-4b7e-b734-c0176bf9a818 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:56:26.074535 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d46bc05e-c26d-4b7e-b734-c0176bf9a818 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:56:26.082422 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d46bc05e-c26d-4b7e-b734-c0176bf9a818 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 200 len: 1513 microversion: 2.1 time: 0.284645 Jul 19 09:56:26.082989 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 970/1911] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:56:25 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 1513 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:56:26.751742 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-c8ddbcbe-0d28-4fe6-b93e-907c48585b12 req-2d7daf40-a5c8-45bc-9574-4af9f6fa8935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f", "name": "network-vif-deleted", "tag": "420353fa-94ca-4654-bcb8-98ba2b387c58"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:56:26.754021 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:56:26.754021 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:56:26.761458 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-c8ddbcbe-0d28-4fe6-b93e-907c48585b12 req-2d7daf40-a5c8-45bc-9574-4af9f6fa8935 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:56:26.761902 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-c8ddbcbe-0d28-4fe6-b93e-907c48585b12 req-2d7daf40-a5c8-45bc-9574-4af9f6fa8935 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:56:26.777050 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-c8ddbcbe-0d28-4fe6-b93e-907c48585b12 req-2d7daf40-a5c8-45bc-9574-4af9f6fa8935 service nova] Creating event network-vif-deleted:420353fa-94ca-4654-bcb8-98ba2b387c58 for instance d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f on hv-cinder-79338 Jul 19 09:56:26.781824 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-c8ddbcbe-0d28-4fe6-b93e-907c48585b12 req-2d7daf40-a5c8-45bc-9574-4af9f6fa8935 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113020 Jul 19 09:56:26.782455 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 942/1912] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:56:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:56:27.099539 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1f629da6-0140-4d1d-958a-abb1d554edc4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:56:27.100688 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1f629da6-0140-4d1d-958a-abb1d554edc4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:56:27.107485 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1f629da6-0140-4d1d-958a-abb1d554edc4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:56:27.107934 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1f629da6-0140-4d1d-958a-abb1d554edc4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:56:27.108692 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1f629da6-0140-4d1d-958a-abb1d554edc4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:56:27.109120 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1f629da6-0140-4d1d-958a-abb1d554edc4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:56:27.141709 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1f629da6-0140-4d1d-958a-abb1d554edc4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:56:27.142173 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1f629da6-0140-4d1d-958a-abb1d554edc4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:56:27.142726 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.objects.instance [None req-1f629da6-0140-4d1d-958a-abb1d554edc4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lazy-loading 'fault' on Instance uuid d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f {{(pid=107463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:56:27.195292 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1f629da6-0140-4d1d-958a-abb1d554edc4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b45b7dbaf5c41a998a64ef62132ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4427b775629d442d9448281ff5171b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:56:27.201967 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1f629da6-0140-4d1d-958a-abb1d554edc4 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 200 len: 1308 microversion: 2.1 time: 0.107149 Jul 19 09:56:27.202523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 971/1913] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:56:27 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:56:28.217929 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-888e1e17-d6b5-472c-a536-7e3a1821c576 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:56:28.218538 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-888e1e17-d6b5-472c-a536-7e3a1821c576 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] [instance: d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:56:28.224516 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-888e1e17-d6b5-472c-a536-7e3a1821c576 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:56:28.225161 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-888e1e17-d6b5-472c-a536-7e3a1821c576 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:56:28.225947 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-888e1e17-d6b5-472c-a536-7e3a1821c576 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:56:28.226378 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-888e1e17-d6b5-472c-a536-7e3a1821c576 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:56:28.239098 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-888e1e17-d6b5-472c-a536-7e3a1821c576 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] HTTP exception thrown: Instance d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f could not be found. Jul 19 09:56:28.239683 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-888e1e17-d6b5-472c-a536-7e3a1821c576 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] Returning 404 to user: Instance d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:56:28.240522 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-888e1e17-d6b5-472c-a536-7e3a1821c576 tempest-AttachVolumeNegativeTest-168858588 tempest-AttachVolumeNegativeTest-168858588-project] 10.222.0.16 "GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f" status: 404 len: 111 microversion: 2.1 time: 0.026695 Jul 19 09:56:28.241031 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 943/1914] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:56:28 2021] GET /compute/v2.1/servers/d5aaa391-256a-4360-bb9d-9ffb8f5c4f4f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:56:55.278961 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:56:55.279568 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:56:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:57:12.903969 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:57:12.904461 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:57:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:58:48.756925 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:58:48.757568 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:58:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:58:54.299957 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:58:54.300450 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:58:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:58:57.290980 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:58:57.291475 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 09:58:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:59:06.377282 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 09:59:06.377717 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 09:59:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 09:59:15.984996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 19 09:59:15.988398 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a931d036-5677-4398-8daf-72f6a5068ce7 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] Calling method '.version_select at 0x7f04b0310550>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:16.041744 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a931d036-5677-4398-8daf-72f6a5068ce7 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4bd0bbf2-55e3-44f8-b685-a39a41799b19" status: 200 len: 349 microversion: 2.1 time: 0.059466 Jul 19 09:59:16.042426 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 972/1915] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Jul 19 09:59:15 2021] GET /compute/v2.1/os-volumes/4bd0bbf2-55e3-44f8-b685-a39a41799b19 => generated 349 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:59:17.374260 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 09:59:17.378129 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-88353fd8-f3a3-4c5e-a14f-518dccdea442 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] Calling method '.version_select at 0x7f04b01ed310>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:17.541568 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-88353fd8-f3a3-4c5e-a14f-518dccdea442 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/e73eee5f-4418-4953-b346-e6edd6289c2c" status: 200 len: 351 microversion: 2.1 time: 0.169208 Jul 19 09:59:17.542072 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 944/1916] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Jul 19 09:59:17 2021] GET /compute/v2.1/os-volumes/e73eee5f-4418-4953-b346-e6edd6289c2c => generated 351 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:59:18.881594 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-90a87206-1cd3-454d-acf0-84cd92ef5014 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] Calling method '.version_select at 0x7f04b01e0160>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:18.897114 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc24f1b5-f8c0-4c06-89ea-965de4af7b8e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43076. Jul 19 09:59:18.944680 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-90a87206-1cd3-454d-acf0-84cd92ef5014 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3bcf0c06-b541-4b8b-abc3-0f1bf98a161b" status: 200 len: 351 microversion: 2.1 time: 0.078258 Jul 19 09:59:18.945499 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 973/1917] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Jul 19 09:59:18 2021] GET /compute/v2.1/os-volumes/3bcf0c06-b541-4b8b-abc3-0f1bf98a161b => generated 351 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:59:18.956533 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-57ce8ed8-1cb2-43d8-9e6a-7a4fcf455e15 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] Calling method '.version_select at 0x7f04b02aedc0>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:18.984945 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43090. Jul 19 09:59:19.055330 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-57ce8ed8-1cb2-43d8-9e6a-7a4fcf455e15 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.102382 Jul 19 09:59:19.055903 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 945/1918] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Jul 19 09:59:18 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:59:19.070367 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e4405ee5-5801-40e8-bffe-6d3fc4183e82 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] Calling method '.version_select at 0x7f04b0568280>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:19.174077 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e4405ee5-5801-40e8-bffe-6d3fc4183e82 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.109162 Jul 19 09:59:19.174519 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 974/1919] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Jul 19 09:59:19 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:59:19.185894 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e5909bb9-742e-4bf1-ac68-8ee95b995c9b tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] Calling method '.version_select at 0x7f04b02e9670>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:19.269224 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e5909bb9-742e-4bf1-ac68-8ee95b995c9b tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086977 Jul 19 09:59:19.269792 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 946/1920] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Jul 19 09:59:19 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:19.280996 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1485a71c-88f8-4da5-b7b3-0f019bafa6bc tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] Calling method '.version_select at 0x7f04b03103a0>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:19.369119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1485a71c-88f8-4da5-b7b3-0f019bafa6bc tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091607 Jul 19 09:59:19.369833 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 975/1921] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Jul 19 09:59:19 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:59:19.381949 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b5f5b3aa-2607-477d-9ba2-4e214b676c09 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] Calling method '.version_select at 0x7f04b02e9f70>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:19.471615 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b5f5b3aa-2607-477d-9ba2-4e214b676c09 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.093100 Jul 19 09:59:19.472388 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 947/1922] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Jul 19 09:59:19 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:59:19.483879 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a476aa79-115d-4a85-b3b6-400faa30fd55 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] Calling method '.version_select at 0x7f04b0458a60>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:19.569846 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a476aa79-115d-4a85-b3b6-400faa30fd55 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089413 Jul 19 09:59:19.570412 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 976/1923] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Jul 19 09:59:19 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:19.582885 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a7c15c9e-f127-409d-9a46-7e455a8fb923 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] Calling method '.version_select at 0x7f04b02ae670>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:19.665832 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a7c15c9e-f127-409d-9a46-7e455a8fb923 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085886 Jul 19 09:59:19.666788 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 948/1924] 10.222.0.16 () {58 vars in 1188 bytes} [Mon Jul 19 09:59:19 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:59:19.679854 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3a779633-2e5c-494c-b02c-c4b89bc17ae0 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] Calling method '.version_select at 0x7f04b0400e50>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:19.774857 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3a779633-2e5c-494c-b02c-c4b89bc17ae0 tempest-VolumesTestJSON-40607709 tempest-VolumesTestJSON-40607709-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.099710 Jul 19 09:59:19.775541 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 977/1925] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Jul 19 09:59:19 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:21.611770 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-620400739", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452", "networks": [{"uuid": "28300a70-8751-49cb-99d8-30f023ef117d"}]}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:59:21.664962 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.network.neutron [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] validate_networks() for [('28300a70-8751-49cb-99d8-30f023ef117d', None, None, None)] {{(pid=107464) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:59:22.053668 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Flavor limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:59:22.054382 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Image limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:59:22.054972 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Flavor pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:59:22.055456 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Image pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:59:22.056143 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:59:22.065044 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:22.066519 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:22.067340 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:22.067778 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:22.085188 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Getting quotas for project 1b3991ce35494ef7a70b942ccd4a4d45. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:59:22.089390 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Getting quotas for user 328c9612e24144a2939c0f3dcce19d35 and project 1b3991ce35494ef7a70b942ccd4a4d45. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:59:22.100947 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Going to run 1 instances... {{(pid=107464) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:59:22.103292 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:59:22.147119 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5b25683c-d101-4c12-8a0c-27739dc1be4f tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539699 Jul 19 09:59:22.147748 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 949/1926] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 09:59:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 09:59:22.157714 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bb6118af-4721-483f-bedc-28a12d852917 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:22.158322 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bb6118af-4721-483f-bedc-28a12d852917 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:22.210198 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bb6118af-4721-483f-bedc-28a12d852917 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:22.216974 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bb6118af-4721-483f-bedc-28a12d852917 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1213 microversion: 2.1 time: 0.063355 Jul 19 09:59:22.217518 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 978/1927] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:22 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:23.233751 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e199877a-4c0f-457c-8051-93a76c4499ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:23.234358 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e199877a-4c0f-457c-8051-93a76c4499ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:23.240834 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e199877a-4c0f-457c-8051-93a76c4499ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:23.241279 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e199877a-4c0f-457c-8051-93a76c4499ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:23.242029 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e199877a-4c0f-457c-8051-93a76c4499ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:23.242454 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e199877a-4c0f-457c-8051-93a76c4499ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:23.301770 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e199877a-4c0f-457c-8051-93a76c4499ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:23.308753 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e199877a-4c0f-457c-8051-93a76c4499ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1217 microversion: 2.1 time: 0.078665 Jul 19 09:59:23.309306 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 950/1928] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:23 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:24.326041 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bb5bc7fe-2e9c-46db-973c-21cc437871bc tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:24.326568 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bb5bc7fe-2e9c-46db-973c-21cc437871bc tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:24.332906 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb5bc7fe-2e9c-46db-973c-21cc437871bc tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:24.333356 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb5bc7fe-2e9c-46db-973c-21cc437871bc tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:24.334120 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb5bc7fe-2e9c-46db-973c-21cc437871bc tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:24.334556 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bb5bc7fe-2e9c-46db-973c-21cc437871bc tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:24.402009 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bb5bc7fe-2e9c-46db-973c-21cc437871bc tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:24.409470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bb5bc7fe-2e9c-46db-973c-21cc437871bc tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1265 microversion: 2.1 time: 0.087150 Jul 19 09:59:24.410040 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 979/1929] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:24 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:59:25.426301 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-798870c7-0baf-4f35-98fb-2175beb540bb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:25.427221 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-798870c7-0baf-4f35-98fb-2175beb540bb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:25.433375 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-798870c7-0baf-4f35-98fb-2175beb540bb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:25.434961 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-798870c7-0baf-4f35-98fb-2175beb540bb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:25.434961 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-798870c7-0baf-4f35-98fb-2175beb540bb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:25.435361 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-798870c7-0baf-4f35-98fb-2175beb540bb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:25.753322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-798870c7-0baf-4f35-98fb-2175beb540bb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:25.760774 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-798870c7-0baf-4f35-98fb-2175beb540bb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1313 microversion: 2.1 time: 0.338158 Jul 19 09:59:25.761389 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 951/1930] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:25 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:26.214052 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-d79fd994-76b1-4a17-bde1-92dde95c49f4 req-84033525-6e0e-4dff-b559-23f5bcd492b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a815619d-509a-46e0-91eb-a96eb97b869e", "tag": "ae8e8dc1-7082-4d4d-b102-69a07591abc9"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:59:26.219138 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:59:26.219138 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:59:26.228719 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-d79fd994-76b1-4a17-bde1-92dde95c49f4 req-84033525-6e0e-4dff-b559-23f5bcd492b6 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:26.229332 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-d79fd994-76b1-4a17-bde1-92dde95c49f4 req-84033525-6e0e-4dff-b559-23f5bcd492b6 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:26.240836 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-d79fd994-76b1-4a17-bde1-92dde95c49f4 req-84033525-6e0e-4dff-b559-23f5bcd492b6 service nova] Creating event network-changed:ae8e8dc1-7082-4d4d-b102-69a07591abc9 for instance a815619d-509a-46e0-91eb-a96eb97b869e on hv-cinder-79338 Jul 19 09:59:26.247670 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-d79fd994-76b1-4a17-bde1-92dde95c49f4 req-84033525-6e0e-4dff-b559-23f5bcd492b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038835 Jul 19 09:59:26.248859 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 980/1931] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:59:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:59:26.779838 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b285076c-1d7f-47ff-836c-ee503bc8b256 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:26.780459 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b285076c-1d7f-47ff-836c-ee503bc8b256 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:26.786627 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b285076c-1d7f-47ff-836c-ee503bc8b256 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:26.787163 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b285076c-1d7f-47ff-836c-ee503bc8b256 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:26.788429 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b285076c-1d7f-47ff-836c-ee503bc8b256 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:26.788869 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b285076c-1d7f-47ff-836c-ee503bc8b256 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:27.090634 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b285076c-1d7f-47ff-836c-ee503bc8b256 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:27.098329 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b285076c-1d7f-47ff-836c-ee503bc8b256 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1313 microversion: 2.1 time: 0.323705 Jul 19 09:59:27.107993 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 952/1932] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:26 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:28.116384 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-49f552e1-d9dd-4b0a-b4bc-c7477cd5cfe6 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:28.117342 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-49f552e1-d9dd-4b0a-b4bc-c7477cd5cfe6 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:28.129005 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49f552e1-d9dd-4b0a-b4bc-c7477cd5cfe6 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:28.130385 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49f552e1-d9dd-4b0a-b4bc-c7477cd5cfe6 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:28.133129 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49f552e1-d9dd-4b0a-b4bc-c7477cd5cfe6 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:28.134520 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-49f552e1-d9dd-4b0a-b4bc-c7477cd5cfe6 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:28.295449 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-49f552e1-d9dd-4b0a-b4bc-c7477cd5cfe6 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:28.303671 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-49f552e1-d9dd-4b0a-b4bc-c7477cd5cfe6 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1313 microversion: 2.1 time: 0.192407 Jul 19 09:59:28.304345 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 981/1933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:28 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:29.320584 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-adfe3045-695e-45fa-ba01-3876a107a88b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:29.321330 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-adfe3045-695e-45fa-ba01-3876a107a88b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:29.327443 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-adfe3045-695e-45fa-ba01-3876a107a88b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:29.328113 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-adfe3045-695e-45fa-ba01-3876a107a88b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:29.329135 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-adfe3045-695e-45fa-ba01-3876a107a88b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:29.329770 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-adfe3045-695e-45fa-ba01-3876a107a88b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:29.466984 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-adfe3045-695e-45fa-ba01-3876a107a88b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:29.474237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-adfe3045-695e-45fa-ba01-3876a107a88b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1313 microversion: 2.1 time: 0.157331 Jul 19 09:59:29.474797 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 953/1934] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:29 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:30.491489 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e560bf12-978f-4fbe-9ccf-e17c848188b3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:30.492188 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e560bf12-978f-4fbe-9ccf-e17c848188b3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:30.497899 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e560bf12-978f-4fbe-9ccf-e17c848188b3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:30.498335 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e560bf12-978f-4fbe-9ccf-e17c848188b3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:30.499109 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e560bf12-978f-4fbe-9ccf-e17c848188b3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:30.499571 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e560bf12-978f-4fbe-9ccf-e17c848188b3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:30.636797 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e560bf12-978f-4fbe-9ccf-e17c848188b3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:30.644983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e560bf12-978f-4fbe-9ccf-e17c848188b3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1313 microversion: 2.1 time: 0.157053 Jul 19 09:59:30.645552 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 982/1935] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:30 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:31.662021 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-862f2d19-aa03-47cc-8efe-06c9bcab88a5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:31.662978 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-862f2d19-aa03-47cc-8efe-06c9bcab88a5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:31.669311 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-862f2d19-aa03-47cc-8efe-06c9bcab88a5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:31.669847 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-862f2d19-aa03-47cc-8efe-06c9bcab88a5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:31.670800 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-862f2d19-aa03-47cc-8efe-06c9bcab88a5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:31.671477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-862f2d19-aa03-47cc-8efe-06c9bcab88a5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:31.817396 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-862f2d19-aa03-47cc-8efe-06c9bcab88a5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:31.825065 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-862f2d19-aa03-47cc-8efe-06c9bcab88a5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1313 microversion: 2.1 time: 0.166652 Jul 19 09:59:31.825841 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 954/1936] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:31 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:32.262081 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-23d7dec9-9aa2-43a5-a3af-15c14ee7e7f3 req-0754e329-8e87-48d2-97d6-3f3ceb86e58b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a815619d-509a-46e0-91eb-a96eb97b869e", "name": "network-vif-plugged", "status": "completed", "tag": "ae8e8dc1-7082-4d4d-b102-69a07591abc9"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:59:32.263808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:59:32.263808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 09:59:32.272334 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-23d7dec9-9aa2-43a5-a3af-15c14ee7e7f3 req-0754e329-8e87-48d2-97d6-3f3ceb86e58b service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:32.272859 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-23d7dec9-9aa2-43a5-a3af-15c14ee7e7f3 req-0754e329-8e87-48d2-97d6-3f3ceb86e58b service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:32.283910 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-23d7dec9-9aa2-43a5-a3af-15c14ee7e7f3 req-0754e329-8e87-48d2-97d6-3f3ceb86e58b service nova] Creating event network-vif-plugged:ae8e8dc1-7082-4d4d-b102-69a07591abc9 for instance a815619d-509a-46e0-91eb-a96eb97b869e on hv-cinder-79338 Jul 19 09:59:32.289255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-23d7dec9-9aa2-43a5-a3af-15c14ee7e7f3 req-0754e329-8e87-48d2-97d6-3f3ceb86e58b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228143 Jul 19 09:59:32.289917 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 983/1937] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:59:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:59:32.843722 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-329f4b2f-9f7e-4175-b9fc-238ef8159b1b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:32.844858 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-329f4b2f-9f7e-4175-b9fc-238ef8159b1b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:32.851056 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-329f4b2f-9f7e-4175-b9fc-238ef8159b1b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:32.851791 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-329f4b2f-9f7e-4175-b9fc-238ef8159b1b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:32.853000 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-329f4b2f-9f7e-4175-b9fc-238ef8159b1b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:32.853438 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-329f4b2f-9f7e-4175-b9fc-238ef8159b1b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:32.986545 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-329f4b2f-9f7e-4175-b9fc-238ef8159b1b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:32.993710 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-329f4b2f-9f7e-4175-b9fc-238ef8159b1b tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1313 microversion: 2.1 time: 0.155960 Jul 19 09:59:32.994269 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 955/1938] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:32 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:34.010176 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d29a6f16-25b0-4c27-9748-3cc322c8f0ee tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:34.010865 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d29a6f16-25b0-4c27-9748-3cc322c8f0ee tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:34.017254 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d29a6f16-25b0-4c27-9748-3cc322c8f0ee tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:34.017693 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d29a6f16-25b0-4c27-9748-3cc322c8f0ee tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:34.018444 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d29a6f16-25b0-4c27-9748-3cc322c8f0ee tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:34.018876 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d29a6f16-25b0-4c27-9748-3cc322c8f0ee tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:34.150383 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d29a6f16-25b0-4c27-9748-3cc322c8f0ee tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:34.157499 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d29a6f16-25b0-4c27-9748-3cc322c8f0ee tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1313 microversion: 2.1 time: 0.151302 Jul 19 09:59:34.158059 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 984/1939] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:34 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:35.173459 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6d072fbd-102b-4436-9cb8-0bc214b0adef tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:35.174052 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-6d072fbd-102b-4436-9cb8-0bc214b0adef tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:35.179789 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6d072fbd-102b-4436-9cb8-0bc214b0adef tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:35.180232 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6d072fbd-102b-4436-9cb8-0bc214b0adef tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:35.181228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6d072fbd-102b-4436-9cb8-0bc214b0adef tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:35.181665 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-6d072fbd-102b-4436-9cb8-0bc214b0adef tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:35.310833 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-6d072fbd-102b-4436-9cb8-0bc214b0adef tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:35.318024 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6d072fbd-102b-4436-9cb8-0bc214b0adef tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1498 microversion: 2.1 time: 0.148293 Jul 19 09:59:35.318582 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 956/1940] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:35 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:38.510935 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-69336276-9d32-4452-ad8b-4cf3bdc3adbd tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:38.511510 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-69336276-9d32-4452-ad8b-4cf3bdc3adbd tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:38.517930 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69336276-9d32-4452-ad8b-4cf3bdc3adbd tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:38.518375 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69336276-9d32-4452-ad8b-4cf3bdc3adbd tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:38.519160 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69336276-9d32-4452-ad8b-4cf3bdc3adbd tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:38.519590 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-69336276-9d32-4452-ad8b-4cf3bdc3adbd tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:38.543348 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-69336276-9d32-4452-ad8b-4cf3bdc3adbd tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Going to try to terminate instance {{(pid=107463) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:59:38.613160 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-69336276-9d32-4452-ad8b-4cf3bdc3adbd tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 204 len: 0 microversion: 2.1 time: 0.105658 Jul 19 09:59:38.613873 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 985/1941] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:59:38 2021] DELETE /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 09:59:38.623537 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-bbfc43d1-81e3-4c4b-9ba2-76aba3281e26 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:38.624201 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-bbfc43d1-81e3-4c4b-9ba2-76aba3281e26 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:38.630409 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bbfc43d1-81e3-4c4b-9ba2-76aba3281e26 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:38.630863 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bbfc43d1-81e3-4c4b-9ba2-76aba3281e26 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:38.631668 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bbfc43d1-81e3-4c4b-9ba2-76aba3281e26 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:38.632104 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-bbfc43d1-81e3-4c4b-9ba2-76aba3281e26 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:38.762572 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-bbfc43d1-81e3-4c4b-9ba2-76aba3281e26 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:38.770394 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-bbfc43d1-81e3-4c4b-9ba2-76aba3281e26 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1504 microversion: 2.1 time: 0.150656 Jul 19 09:59:38.770949 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 957/1942] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:38 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:39.788552 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a8a8388a-0d70-4dd6-b306-689920a8eee7 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:39.789243 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a8a8388a-0d70-4dd6-b306-689920a8eee7 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:39.794908 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a8a8388a-0d70-4dd6-b306-689920a8eee7 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:39.795387 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a8a8388a-0d70-4dd6-b306-689920a8eee7 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:39.796168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a8a8388a-0d70-4dd6-b306-689920a8eee7 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:39.796598 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a8a8388a-0d70-4dd6-b306-689920a8eee7 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:39.930062 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a8a8388a-0d70-4dd6-b306-689920a8eee7 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:39.937204 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a8a8388a-0d70-4dd6-b306-689920a8eee7 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1504 microversion: 2.1 time: 0.152874 Jul 19 09:59:39.937763 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 986/1943] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:39 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:40.536086 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-445d7360-767c-4b70-abec-a43bc0a452b2 req-1b30b62c-0abf-4c30-bf7d-7f9c055c3a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a815619d-509a-46e0-91eb-a96eb97b869e", "name": "network-vif-deleted", "tag": "ae8e8dc1-7082-4d4d-b102-69a07591abc9"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:59:40.537903 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:59:40.537903 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:59:40.544876 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-445d7360-767c-4b70-abec-a43bc0a452b2 req-1b30b62c-0abf-4c30-bf7d-7f9c055c3a70 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:40.545328 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-445d7360-767c-4b70-abec-a43bc0a452b2 req-1b30b62c-0abf-4c30-bf7d-7f9c055c3a70 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:40.556468 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-445d7360-767c-4b70-abec-a43bc0a452b2 req-1b30b62c-0abf-4c30-bf7d-7f9c055c3a70 service nova] Creating event network-vif-deleted:ae8e8dc1-7082-4d4d-b102-69a07591abc9 for instance a815619d-509a-46e0-91eb-a96eb97b869e on hv-cinder-79338 Jul 19 09:59:40.562407 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-445d7360-767c-4b70-abec-a43bc0a452b2 req-1b30b62c-0abf-4c30-bf7d-7f9c055c3a70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030707 Jul 19 09:59:40.563005 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 958/1944] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:59:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:59:40.954000 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f4f13d0d-3f26-49e9-8e43-b67e41d3f8ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:40.955195 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f4f13d0d-3f26-49e9-8e43-b67e41d3f8ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:40.961031 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4f13d0d-3f26-49e9-8e43-b67e41d3f8ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:40.961477 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4f13d0d-3f26-49e9-8e43-b67e41d3f8ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:40.962232 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4f13d0d-3f26-49e9-8e43-b67e41d3f8ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:40.962664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4f13d0d-3f26-49e9-8e43-b67e41d3f8ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:40.991378 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4f13d0d-3f26-49e9-8e43-b67e41d3f8ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:40.991757 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f4f13d0d-3f26-49e9-8e43-b67e41d3f8ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:40.992195 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.objects.instance [None req-f4f13d0d-3f26-49e9-8e43-b67e41d3f8ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lazy-loading 'fault' on Instance uuid a815619d-509a-46e0-91eb-a96eb97b869e {{(pid=107463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:59:41.032231 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-f4f13d0d-3f26-49e9-8e43-b67e41d3f8ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:41.039416 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f4f13d0d-3f26-49e9-8e43-b67e41d3f8ae tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1303 microversion: 2.1 time: 0.089088 Jul 19 09:59:41.039969 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 987/1945] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:40 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1303 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:42.055516 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-87dc1943-c86f-41d1-9a29-91b211e385aa tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:42.056155 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-87dc1943-c86f-41d1-9a29-91b211e385aa tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:42.063716 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-87dc1943-c86f-41d1-9a29-91b211e385aa tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:42.064287 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-87dc1943-c86f-41d1-9a29-91b211e385aa tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:42.065295 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-87dc1943-c86f-41d1-9a29-91b211e385aa tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:42.065797 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-87dc1943-c86f-41d1-9a29-91b211e385aa tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:42.095250 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-87dc1943-c86f-41d1-9a29-91b211e385aa tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:42.096221 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-87dc1943-c86f-41d1-9a29-91b211e385aa tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:42.096661 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.objects.instance [None req-87dc1943-c86f-41d1-9a29-91b211e385aa tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lazy-loading 'fault' on Instance uuid a815619d-509a-46e0-91eb-a96eb97b869e {{(pid=107464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:59:42.136093 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-87dc1943-c86f-41d1-9a29-91b211e385aa tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:42.144042 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-87dc1943-c86f-41d1-9a29-91b211e385aa tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1303 microversion: 2.1 time: 0.092565 Jul 19 09:59:42.144601 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 959/1946] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:42 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:43.160602 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1442273d-0926-4c36-81dc-37584add04eb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:43.161216 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1442273d-0926-4c36-81dc-37584add04eb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:43.167679 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1442273d-0926-4c36-81dc-37584add04eb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:43.167798 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1442273d-0926-4c36-81dc-37584add04eb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:43.168496 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1442273d-0926-4c36-81dc-37584add04eb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:43.168926 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1442273d-0926-4c36-81dc-37584add04eb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:43.198117 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1442273d-0926-4c36-81dc-37584add04eb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:43.198563 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1442273d-0926-4c36-81dc-37584add04eb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:43.199004 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.objects.instance [None req-1442273d-0926-4c36-81dc-37584add04eb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lazy-loading 'fault' on Instance uuid a815619d-509a-46e0-91eb-a96eb97b869e {{(pid=107463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 09:59:43.238157 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1442273d-0926-4c36-81dc-37584add04eb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:43.245146 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1442273d-0926-4c36-81dc-37584add04eb tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 200 len: 1303 microversion: 2.1 time: 0.088396 Jul 19 09:59:43.245705 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 988/1947] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:43 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 1303 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:44.261477 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d323cce2-6571-41c6-80cc-4cdab8d5ceb4 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:44.262097 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-d323cce2-6571-41c6-80cc-4cdab8d5ceb4 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: a815619d-509a-46e0-91eb-a96eb97b869e] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:44.268014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d323cce2-6571-41c6-80cc-4cdab8d5ceb4 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:44.268467 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d323cce2-6571-41c6-80cc-4cdab8d5ceb4 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:44.269245 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d323cce2-6571-41c6-80cc-4cdab8d5ceb4 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:44.269684 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-d323cce2-6571-41c6-80cc-4cdab8d5ceb4 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:44.282713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-d323cce2-6571-41c6-80cc-4cdab8d5ceb4 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] HTTP exception thrown: Instance a815619d-509a-46e0-91eb-a96eb97b869e could not be found. Jul 19 09:59:44.283322 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d323cce2-6571-41c6-80cc-4cdab8d5ceb4 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Returning 404 to user: Instance a815619d-509a-46e0-91eb-a96eb97b869e could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 09:59:44.284142 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d323cce2-6571-41c6-80cc-4cdab8d5ceb4 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e" status: 404 len: 111 microversion: 2.1 time: 0.026384 Jul 19 09:59:44.284656 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 960/1948] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:44 2021] GET /compute/v2.1/servers/a815619d-509a-46e0-91eb-a96eb97b869e => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 09:59:44.374660 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-295079889", "imageRef": "0f69183c-9426-4298-9893-c56dbc5c79d8", "flavorRef": "452", "networks": [{"uuid": "28300a70-8751-49cb-99d8-30f023ef117d"}]}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:59:44.426354 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.network.neutron [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] validate_networks() for [('28300a70-8751-49cb-99d8-30f023ef117d', None, None, None)] {{(pid=107463) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 09:59:44.877662 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Flavor limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 09:59:44.878089 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Image limits 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 09:59:44.878714 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Flavor pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 09:59:44.879177 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Image pref 0:0:0 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 09:59:44.879596 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.virt.hardware [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 09:59:44.888636 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:44.889089 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:44.889916 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:44.890348 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:44.908285 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Getting quotas for project 1b3991ce35494ef7a70b942ccd4a4d45. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 09:59:44.912185 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Getting quotas for user 328c9612e24144a2939c0f3dcce19d35 and project 1b3991ce35494ef7a70b942ccd4a4d45. Resources: {'ram', 'cores', 'instances'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 09:59:44.923683 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Going to run 1 instances... {{(pid=107463) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 09:59:44.925991 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f69183c-9426-4298-9893-c56dbc5c79d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107463) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 09:59:44.971178 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-583911a6-6c5b-497c-a93b-7cb843ea0b8d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599642 Jul 19 09:59:44.971809 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 989/1949] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 09:59:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 09:59:44.981397 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3707b77c-f6e9-4fd9-a801-c19aeaa56c7d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:44.982117 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3707b77c-f6e9-4fd9-a801-c19aeaa56c7d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:45.035685 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-3707b77c-f6e9-4fd9-a801-c19aeaa56c7d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:45.042668 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3707b77c-f6e9-4fd9-a801-c19aeaa56c7d tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1213 microversion: 2.1 time: 0.064928 Jul 19 09:59:45.043270 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 961/1950] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:44 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:46.059209 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-88873574-5d6e-4f79-8feb-497791959679 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:46.060325 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-88873574-5d6e-4f79-8feb-497791959679 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:46.067535 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88873574-5d6e-4f79-8feb-497791959679 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:46.067986 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88873574-5d6e-4f79-8feb-497791959679 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:46.068760 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88873574-5d6e-4f79-8feb-497791959679 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:46.069203 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-88873574-5d6e-4f79-8feb-497791959679 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:46.134963 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-88873574-5d6e-4f79-8feb-497791959679 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:46.162918 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-88873574-5d6e-4f79-8feb-497791959679 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1271 microversion: 2.1 time: 0.102386 Jul 19 09:59:46.162918 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 990/1951] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:46 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:47.176489 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-71bb7ca4-a8c1-4d27-83d0-7065dd086265 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:47.177106 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-71bb7ca4-a8c1-4d27-83d0-7065dd086265 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:47.182947 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-71bb7ca4-a8c1-4d27-83d0-7065dd086265 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:47.183424 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-71bb7ca4-a8c1-4d27-83d0-7065dd086265 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:47.184191 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-71bb7ca4-a8c1-4d27-83d0-7065dd086265 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:47.184626 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-71bb7ca4-a8c1-4d27-83d0-7065dd086265 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:47.321923 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-71bb7ca4-a8c1-4d27-83d0-7065dd086265 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:47.329259 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-71bb7ca4-a8c1-4d27-83d0-7065dd086265 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1313 microversion: 2.1 time: 0.156403 Jul 19 09:59:47.329817 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 962/1952] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:47 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:48.346196 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-3f995cc2-24fa-4041-b5b3-922694b0e930 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:48.346809 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-3f995cc2-24fa-4041-b5b3-922694b0e930 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:48.352523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3f995cc2-24fa-4041-b5b3-922694b0e930 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:48.352973 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3f995cc2-24fa-4041-b5b3-922694b0e930 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:48.353726 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3f995cc2-24fa-4041-b5b3-922694b0e930 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:48.354164 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-3f995cc2-24fa-4041-b5b3-922694b0e930 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:48.496728 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-3f995cc2-24fa-4041-b5b3-922694b0e930 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:48.508228 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-3f995cc2-24fa-4041-b5b3-922694b0e930 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1313 microversion: 2.1 time: 0.165680 Jul 19 09:59:48.508800 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 991/1953] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:48 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:48.584130 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-de2229ec-ac23-45d6-b08e-96647ed84f74 req-e339cdec-b0f6-4d79-8e47-3ce967644aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d33b6b14-b8a5-453d-8aa2-6a44a81c07e2", "tag": "6a52d25b-b244-4b4f-a439-e172fbd7faaf"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:59:48.585702 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:59:48.585702 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:59:48.592664 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-de2229ec-ac23-45d6-b08e-96647ed84f74 req-e339cdec-b0f6-4d79-8e47-3ce967644aa9 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:48.593174 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-de2229ec-ac23-45d6-b08e-96647ed84f74 req-e339cdec-b0f6-4d79-8e47-3ce967644aa9 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:48.603808 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-de2229ec-ac23-45d6-b08e-96647ed84f74 req-e339cdec-b0f6-4d79-8e47-3ce967644aa9 service nova] Creating event network-changed:6a52d25b-b244-4b4f-a439-e172fbd7faaf for instance d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 on hv-cinder-79338 Jul 19 09:59:48.608307 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-de2229ec-ac23-45d6-b08e-96647ed84f74 req-e339cdec-b0f6-4d79-8e47-3ce967644aa9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028501 Jul 19 09:59:48.608881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 963/1954] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:59:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:59:49.525157 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4e8bf8f3-2f33-4157-9c1a-db2537648ba2 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:49.525770 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4e8bf8f3-2f33-4157-9c1a-db2537648ba2 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:49.531846 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4e8bf8f3-2f33-4157-9c1a-db2537648ba2 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:49.532205 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4e8bf8f3-2f33-4157-9c1a-db2537648ba2 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:49.532959 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4e8bf8f3-2f33-4157-9c1a-db2537648ba2 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:49.533402 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4e8bf8f3-2f33-4157-9c1a-db2537648ba2 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:49.672845 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4e8bf8f3-2f33-4157-9c1a-db2537648ba2 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:49.680905 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4e8bf8f3-2f33-4157-9c1a-db2537648ba2 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1313 microversion: 2.1 time: 0.159570 Jul 19 09:59:49.681472 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 992/1955] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:49 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:50.699377 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1df31a2d-236e-4bab-b7e2-6c53f0918bb5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:50.700076 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1df31a2d-236e-4bab-b7e2-6c53f0918bb5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:50.706539 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1df31a2d-236e-4bab-b7e2-6c53f0918bb5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:50.707014 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1df31a2d-236e-4bab-b7e2-6c53f0918bb5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:50.707804 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1df31a2d-236e-4bab-b7e2-6c53f0918bb5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:50.708240 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1df31a2d-236e-4bab-b7e2-6c53f0918bb5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:50.861300 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1df31a2d-236e-4bab-b7e2-6c53f0918bb5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:50.870096 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1df31a2d-236e-4bab-b7e2-6c53f0918bb5 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1313 microversion: 2.1 time: 0.174877 Jul 19 09:59:50.870978 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 964/1956] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:50 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:51.888037 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e990b9d7-f864-414e-ada4-9f1116e0f349 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:51.888645 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e990b9d7-f864-414e-ada4-9f1116e0f349 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:51.894316 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e990b9d7-f864-414e-ada4-9f1116e0f349 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:51.895280 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e990b9d7-f864-414e-ada4-9f1116e0f349 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:51.896027 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e990b9d7-f864-414e-ada4-9f1116e0f349 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:51.896450 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e990b9d7-f864-414e-ada4-9f1116e0f349 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:52.032607 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-e990b9d7-f864-414e-ada4-9f1116e0f349 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:52.040282 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e990b9d7-f864-414e-ada4-9f1116e0f349 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1313 microversion: 2.1 time: 0.155953 Jul 19 09:59:52.040845 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 993/1957] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:51 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:53.057275 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-da92ad28-0d04-4803-9928-0eb113f21174 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:53.057920 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-da92ad28-0d04-4803-9928-0eb113f21174 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:53.064216 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-da92ad28-0d04-4803-9928-0eb113f21174 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:53.064743 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-da92ad28-0d04-4803-9928-0eb113f21174 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:53.065583 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-da92ad28-0d04-4803-9928-0eb113f21174 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:53.066019 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-da92ad28-0d04-4803-9928-0eb113f21174 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:53.201264 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-da92ad28-0d04-4803-9928-0eb113f21174 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:53.208884 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-da92ad28-0d04-4803-9928-0eb113f21174 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1313 microversion: 2.1 time: 0.155295 Jul 19 09:59:53.209448 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 965/1958] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:53 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:54.226037 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-08ab2f7f-efef-4091-9a1f-be3b180ea088 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:54.226641 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-08ab2f7f-efef-4091-9a1f-be3b180ea088 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:54.232349 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-08ab2f7f-efef-4091-9a1f-be3b180ea088 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:54.232794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-08ab2f7f-efef-4091-9a1f-be3b180ea088 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:54.233548 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-08ab2f7f-efef-4091-9a1f-be3b180ea088 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:54.233980 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-08ab2f7f-efef-4091-9a1f-be3b180ea088 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:54.362484 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-08ab2f7f-efef-4091-9a1f-be3b180ea088 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:54.370064 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-08ab2f7f-efef-4091-9a1f-be3b180ea088 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1313 microversion: 2.1 time: 0.148199 Jul 19 09:59:54.370620 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 994/1959] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:54 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:55.386439 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-f6e7066e-e7f7-442b-be21-509d4faa3765 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:55.387063 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-f6e7066e-e7f7-442b-be21-509d4faa3765 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:55.392783 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f6e7066e-e7f7-442b-be21-509d4faa3765 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:55.393223 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f6e7066e-e7f7-442b-be21-509d4faa3765 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:55.394073 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f6e7066e-e7f7-442b-be21-509d4faa3765 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:55.394516 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-f6e7066e-e7f7-442b-be21-509d4faa3765 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:55.549005 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-f6e7066e-e7f7-442b-be21-509d4faa3765 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:55.556270 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-f6e7066e-e7f7-442b-be21-509d4faa3765 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1313 microversion: 2.1 time: 0.173194 Jul 19 09:59:55.557541 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 966/1960] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:55 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:56.573527 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-950d9ac3-b144-4468-ba40-613dbf4ffe72 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:56.574140 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-950d9ac3-b144-4468-ba40-613dbf4ffe72 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:56.579874 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-950d9ac3-b144-4468-ba40-613dbf4ffe72 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:56.580360 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-950d9ac3-b144-4468-ba40-613dbf4ffe72 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:56.581131 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-950d9ac3-b144-4468-ba40-613dbf4ffe72 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:56.581564 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-950d9ac3-b144-4468-ba40-613dbf4ffe72 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:56.742207 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-950d9ac3-b144-4468-ba40-613dbf4ffe72 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:56.749794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-950d9ac3-b144-4468-ba40-613dbf4ffe72 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1313 microversion: 2.1 time: 0.179920 Jul 19 09:59:56.759609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 995/1961] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:56 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 09:59:57.196040 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-b0e5d383-c938-4917-a639-3f08aef92c46 req-6e48cd31-54d3-4bbf-a8df-301f889c15d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d33b6b14-b8a5-453d-8aa2-6a44a81c07e2", "name": "network-vif-plugged", "status": "completed", "tag": "6a52d25b-b244-4b4f-a439-e172fbd7faaf"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 09:59:57.197645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 09:59:57.197645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 09:59:57.205156 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-b0e5d383-c938-4917-a639-3f08aef92c46 req-6e48cd31-54d3-4bbf-a8df-301f889c15d1 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:57.206002 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-b0e5d383-c938-4917-a639-3f08aef92c46 req-6e48cd31-54d3-4bbf-a8df-301f889c15d1 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:57.218289 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-b0e5d383-c938-4917-a639-3f08aef92c46 req-6e48cd31-54d3-4bbf-a8df-301f889c15d1 service nova] Creating event network-vif-plugged:6a52d25b-b244-4b4f-a439-e172fbd7faaf for instance d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 on hv-cinder-79338 Jul 19 09:59:57.223866 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-b0e5d383-c938-4917-a639-3f08aef92c46 req-6e48cd31-54d3-4bbf-a8df-301f889c15d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032156 Jul 19 09:59:57.224526 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 967/1962] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 09:59:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 09:59:57.766590 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-ec6cad35-8970-49bd-b327-b92989cba9d3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:57.767259 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-ec6cad35-8970-49bd-b327-b92989cba9d3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:57.772836 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ec6cad35-8970-49bd-b327-b92989cba9d3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:57.773280 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ec6cad35-8970-49bd-b327-b92989cba9d3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:57.774037 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ec6cad35-8970-49bd-b327-b92989cba9d3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:57.774462 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-ec6cad35-8970-49bd-b327-b92989cba9d3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:57.911618 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-ec6cad35-8970-49bd-b327-b92989cba9d3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:57.919207 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-ec6cad35-8970-49bd-b327-b92989cba9d3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1313 microversion: 2.1 time: 0.156085 Jul 19 09:59:57.919773 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 996/1963] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:57 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:58.937423 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-903f843d-5f0a-46f9-a286-63b9305f1300 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:58.938337 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-903f843d-5f0a-46f9-a286-63b9305f1300 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:58.944820 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-903f843d-5f0a-46f9-a286-63b9305f1300 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:58.945340 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-903f843d-5f0a-46f9-a286-63b9305f1300 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:58.946189 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-903f843d-5f0a-46f9-a286-63b9305f1300 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:58.946692 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-903f843d-5f0a-46f9-a286-63b9305f1300 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:59.087411 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-903f843d-5f0a-46f9-a286-63b9305f1300 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:59.094641 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-903f843d-5f0a-46f9-a286-63b9305f1300 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1498 microversion: 2.1 time: 0.161295 Jul 19 09:59:59.095419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 968/1964] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:58 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 09:59:59.606566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5127b671-a71e-44ec-bff6-eff4aa171807 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:59.607153 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5127b671-a71e-44ec-bff6-eff4aa171807 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:59.613010 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5127b671-a71e-44ec-bff6-eff4aa171807 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:59.614114 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5127b671-a71e-44ec-bff6-eff4aa171807 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:59.614907 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5127b671-a71e-44ec-bff6-eff4aa171807 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:59.615375 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5127b671-a71e-44ec-bff6-eff4aa171807 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:59.639945 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5127b671-a71e-44ec-bff6-eff4aa171807 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Going to try to terminate instance {{(pid=107463) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 09:59:59.735541 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5127b671-a71e-44ec-bff6-eff4aa171807 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 204 len: 0 microversion: 2.1 time: 0.132452 Jul 19 09:59:59.736451 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 997/1965] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 09:59:59 2021] DELETE /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 09:59:59.745615 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ba378e6f-bab2-4be6-bcd2-9d26c3fc7828 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 09:59:59.746367 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ba378e6f-bab2-4be6-bcd2-9d26c3fc7828 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 09:59:59.752165 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba378e6f-bab2-4be6-bcd2-9d26c3fc7828 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:59.752881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba378e6f-bab2-4be6-bcd2-9d26c3fc7828 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:59.753734 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba378e6f-bab2-4be6-bcd2-9d26c3fc7828 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 09:59:59.754369 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba378e6f-bab2-4be6-bcd2-9d26c3fc7828 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 09:59:59.927240 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ba378e6f-bab2-4be6-bcd2-9d26c3fc7828 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 09:59:59.934546 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ba378e6f-bab2-4be6-bcd2-9d26c3fc7828 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1504 microversion: 2.1 time: 0.192634 Jul 19 09:59:59.935132 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 969/1966] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 09:59:59 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:00:00.951740 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-9a01030d-fb89-4967-a962-5597abdacdb3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:00:00.952331 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-9a01030d-fb89-4967-a962-5597abdacdb3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:00:00.958063 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9a01030d-fb89-4967-a962-5597abdacdb3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:00:00.958512 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9a01030d-fb89-4967-a962-5597abdacdb3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:00:00.959306 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9a01030d-fb89-4967-a962-5597abdacdb3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:00:00.959736 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-9a01030d-fb89-4967-a962-5597abdacdb3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:00:01.100607 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-9a01030d-fb89-4967-a962-5597abdacdb3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:00:01.107902 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-9a01030d-fb89-4967-a962-5597abdacdb3 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1504 microversion: 2.1 time: 0.160380 Jul 19 10:00:01.108479 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 998/1967] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:00:00 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:00:01.679745 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-4d4a294e-e93f-4e7d-8ad9-7292dc0f29d3 req-c0f4f344-8003-4fb0-934e-57c11c34042c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d33b6b14-b8a5-453d-8aa2-6a44a81c07e2", "name": "network-vif-deleted", "tag": "6a52d25b-b244-4b4f-a439-e172fbd7faaf"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:00:01.682713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 10:00:01.682713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 10:00:01.692701 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-4d4a294e-e93f-4e7d-8ad9-7292dc0f29d3 req-c0f4f344-8003-4fb0-934e-57c11c34042c service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:00:01.693444 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-4d4a294e-e93f-4e7d-8ad9-7292dc0f29d3 req-c0f4f344-8003-4fb0-934e-57c11c34042c service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:00:01.708288 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-4d4a294e-e93f-4e7d-8ad9-7292dc0f29d3 req-c0f4f344-8003-4fb0-934e-57c11c34042c service nova] Creating event network-vif-deleted:6a52d25b-b244-4b4f-a439-e172fbd7faaf for instance d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 on hv-cinder-79338 Jul 19 10:00:01.715446 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-4d4a294e-e93f-4e7d-8ad9-7292dc0f29d3 req-c0f4f344-8003-4fb0-934e-57c11c34042c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039657 Jul 19 10:00:01.716268 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 970/1968] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 10:00:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:00:02.125167 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1fb1f2c2-b39a-4e54-98b0-27b74e2dd712 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:00:02.125734 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1fb1f2c2-b39a-4e54-98b0-27b74e2dd712 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:00:02.132143 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1fb1f2c2-b39a-4e54-98b0-27b74e2dd712 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:00:02.132596 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1fb1f2c2-b39a-4e54-98b0-27b74e2dd712 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:00:02.133358 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1fb1f2c2-b39a-4e54-98b0-27b74e2dd712 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:00:02.133788 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1fb1f2c2-b39a-4e54-98b0-27b74e2dd712 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:00:02.166739 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1fb1f2c2-b39a-4e54-98b0-27b74e2dd712 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:00:02.167434 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1fb1f2c2-b39a-4e54-98b0-27b74e2dd712 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:00:02.168046 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.objects.instance [None req-1fb1f2c2-b39a-4e54-98b0-27b74e2dd712 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lazy-loading 'fault' on Instance uuid d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 {{(pid=107463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 10:00:02.213675 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1fb1f2c2-b39a-4e54-98b0-27b74e2dd712 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '328c9612e24144a2939c0f3dcce19d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3991ce35494ef7a70b942ccd4a4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:00:02.220828 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1fb1f2c2-b39a-4e54-98b0-27b74e2dd712 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 200 len: 1303 microversion: 2.1 time: 0.099643 Jul 19 10:00:02.221409 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 999/1969] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:00:02 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:00:03.238375 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5aeb956f-f117-41a9-8300-e56f20805330 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:00:03.239169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5aeb956f-f117-41a9-8300-e56f20805330 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] [instance: d33b6b14-b8a5-453d-8aa2-6a44a81c07e2] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:00:03.246366 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5aeb956f-f117-41a9-8300-e56f20805330 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:00:03.246819 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5aeb956f-f117-41a9-8300-e56f20805330 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:00:03.247922 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5aeb956f-f117-41a9-8300-e56f20805330 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:00:03.248462 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5aeb956f-f117-41a9-8300-e56f20805330 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:00:03.262285 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-5aeb956f-f117-41a9-8300-e56f20805330 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] HTTP exception thrown: Instance d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 could not be found. Jul 19 10:00:03.263112 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5aeb956f-f117-41a9-8300-e56f20805330 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] Returning 404 to user: Instance d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 10:00:03.263916 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5aeb956f-f117-41a9-8300-e56f20805330 tempest-VolumesActionsTest-1130301338 tempest-VolumesActionsTest-1130301338-project] 10.222.0.16 "GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2" status: 404 len: 111 microversion: 2.1 time: 0.029712 Jul 19 10:00:03.270063 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 971/1970] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:00:03 2021] GET /compute/v2.1/servers/d33b6b14-b8a5-453d-8aa2-6a44a81c07e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 10:00:32.920886 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 10:00:32.921443 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 10:00:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 10:00:56.321722 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0019343e-0870-441d-baa3-ee7f0d7bfd52 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Action: 'create', calling method: .version_select at 0x7f04b0568700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1413384313"}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:00:56.339304 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-0019343e-0870-441d-baa3-ee7f0d7bfd52 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Getting quotas for project 3116e7df5a2642949510b33d79e0bedf. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 10:00:56.343121 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-0019343e-0870-441d-baa3-ee7f0d7bfd52 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Getting quotas for user dce7d147f2dc42b0ad38ceb1a681c252 and project 3116e7df5a2642949510b33d79e0bedf. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 10:00:56.550790 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-0019343e-0870-441d-baa3-ee7f0d7bfd52 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Getting quotas for project 3116e7df5a2642949510b33d79e0bedf. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 10:00:56.554281 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.quota [None req-0019343e-0870-441d-baa3-ee7f0d7bfd52 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Getting quotas for user dce7d147f2dc42b0ad38ceb1a681c252 and project 3116e7df5a2642949510b33d79e0bedf. Resources: {'key_pairs'} {{(pid=107463) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 10:00:56.566650 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0019343e-0870-441d-baa3-ee7f0d7bfd52 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.248897 Jul 19 10:00:56.567277 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1000/1971] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jul 19 10:00:56 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 10:00:56.612926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1562079178", "imageRef": "8c2546d3-82b9-4d2d-8444-65b5d8c900af", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1413384313", "networks": [{"uuid": "a4608b64-ce56-4396-be25-1c1b1adf6995"}]}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:00:56.665303 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.network.neutron [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] validate_networks() for [('a4608b64-ce56-4396-be25-1c1b1adf6995', None, None, None)] {{(pid=107464) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 19 10:00:57.040077 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Flavor limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 10:00:57.040586 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Image limits 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 10:00:57.041261 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Flavor pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 10:00:57.041674 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Image pref 0:0:0 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 10:00:57.042085 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.virt.hardware [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107464) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 10:00:57.050743 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:00:57.051858 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:00:57.052333 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:00:57.052776 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:00:57.070632 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Getting quotas for project 3116e7df5a2642949510b33d79e0bedf. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 19 10:00:57.074967 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.quota [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Getting quotas for user dce7d147f2dc42b0ad38ceb1a681c252 and project 3116e7df5a2642949510b33d79e0bedf. Resources: {'ram', 'cores', 'instances'} {{(pid=107464) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 19 10:00:57.089784 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Going to run 1 instances... {{(pid=107464) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 19 10:00:57.092490 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c2546d3-82b9-4d2d-8444-65b5d8c900af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107464) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 19 10:00:57.153044 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3b1a4d9c-093d-469a-8b9e-37351210e81f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544556 Jul 19 10:00:57.154035 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 972/1972] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Jul 19 10:00:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 10:00:57.164756 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-940a1424-f550-47be-86a6-287eb47f792a tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:00:57.165719 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-940a1424-f550-47be-86a6-287eb47f792a tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:00:57.226917 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-940a1424-f550-47be-86a6-287eb47f792a tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:00:57.235048 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-940a1424-f550-47be-86a6-287eb47f792a tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1259 microversion: 2.1 time: 0.074096 Jul 19 10:00:57.235706 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1001/1973] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:00:57 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:00:58.257310 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1105216b-4768-4897-928e-b8e97b8b655f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:00:58.257950 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1105216b-4768-4897-928e-b8e97b8b655f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:00:58.276419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1105216b-4768-4897-928e-b8e97b8b655f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:00:58.276419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1105216b-4768-4897-928e-b8e97b8b655f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:00:58.276419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1105216b-4768-4897-928e-b8e97b8b655f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:00:58.276419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1105216b-4768-4897-928e-b8e97b8b655f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:00:58.353108 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1105216b-4768-4897-928e-b8e97b8b655f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:00:58.365638 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1105216b-4768-4897-928e-b8e97b8b655f tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1317 microversion: 2.1 time: 0.113517 Jul 19 10:00:58.366669 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 973/1974] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:00:58 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1317 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:00:59.383105 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-423f7a8c-33d7-485e-8d81-6f625879ddd6 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:00:59.383792 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-423f7a8c-33d7-485e-8d81-6f625879ddd6 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:00:59.390295 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-423f7a8c-33d7-485e-8d81-6f625879ddd6 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:00:59.391280 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-423f7a8c-33d7-485e-8d81-6f625879ddd6 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:00:59.392056 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-423f7a8c-33d7-485e-8d81-6f625879ddd6 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:00:59.392487 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-423f7a8c-33d7-485e-8d81-6f625879ddd6 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:00:59.554870 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-423f7a8c-33d7-485e-8d81-6f625879ddd6 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:00:59.562515 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-423f7a8c-33d7-485e-8d81-6f625879ddd6 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1359 microversion: 2.1 time: 0.183055 Jul 19 10:00:59.563095 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1002/1975] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:00:59 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:00.578809 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2a24edbc-e572-4278-b663-eaadfe1d3033 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:00.579625 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-2a24edbc-e572-4278-b663-eaadfe1d3033 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:00.586152 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2a24edbc-e572-4278-b663-eaadfe1d3033 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:00.586620 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2a24edbc-e572-4278-b663-eaadfe1d3033 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:00.587510 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2a24edbc-e572-4278-b663-eaadfe1d3033 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:00.588015 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-2a24edbc-e572-4278-b663-eaadfe1d3033 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:00.757554 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-2a24edbc-e572-4278-b663-eaadfe1d3033 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:00.769816 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2a24edbc-e572-4278-b663-eaadfe1d3033 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1359 microversion: 2.1 time: 0.194668 Jul 19 10:01:00.770606 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 974/1976] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:00 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:01.786509 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-052943d7-0c33-4dea-b768-2e0b3cbb2c98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:01.788018 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-052943d7-0c33-4dea-b768-2e0b3cbb2c98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:01.794086 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-052943d7-0c33-4dea-b768-2e0b3cbb2c98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:01.794550 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-052943d7-0c33-4dea-b768-2e0b3cbb2c98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:01.795436 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-052943d7-0c33-4dea-b768-2e0b3cbb2c98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:01.795871 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-052943d7-0c33-4dea-b768-2e0b3cbb2c98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:01.931537 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-052943d7-0c33-4dea-b768-2e0b3cbb2c98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:01.939631 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-052943d7-0c33-4dea-b768-2e0b3cbb2c98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1359 microversion: 2.1 time: 0.156066 Jul 19 10:01:01.940205 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1003/1977] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:01 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:02.961288 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-965984b7-6ece-436e-bf71-4e1351d4c30b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:02.961997 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-965984b7-6ece-436e-bf71-4e1351d4c30b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:02.968956 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-965984b7-6ece-436e-bf71-4e1351d4c30b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:02.969405 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-965984b7-6ece-436e-bf71-4e1351d4c30b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:02.971096 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-965984b7-6ece-436e-bf71-4e1351d4c30b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:02.971534 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-965984b7-6ece-436e-bf71-4e1351d4c30b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:03.136595 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-965984b7-6ece-436e-bf71-4e1351d4c30b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:03.144987 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-965984b7-6ece-436e-bf71-4e1351d4c30b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1359 microversion: 2.1 time: 0.188057 Jul 19 10:01:03.146094 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 975/1978] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:02 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:04.163813 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-fefbb346-5d74-4e6f-8e01-c13812f0a4d0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:04.164511 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-fefbb346-5d74-4e6f-8e01-c13812f0a4d0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:04.170794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fefbb346-5d74-4e6f-8e01-c13812f0a4d0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:04.171338 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fefbb346-5d74-4e6f-8e01-c13812f0a4d0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:04.172195 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fefbb346-5d74-4e6f-8e01-c13812f0a4d0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:04.172692 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-fefbb346-5d74-4e6f-8e01-c13812f0a4d0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:04.308952 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-fefbb346-5d74-4e6f-8e01-c13812f0a4d0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:04.316954 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-fefbb346-5d74-4e6f-8e01-c13812f0a4d0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1359 microversion: 2.1 time: 0.157004 Jul 19 10:01:04.317566 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1004/1979] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:04 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:05.335001 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-21bf7b57-a096-49e4-a228-4364a2f6c6f0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:05.335712 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-21bf7b57-a096-49e4-a228-4364a2f6c6f0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:05.341854 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-21bf7b57-a096-49e4-a228-4364a2f6c6f0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:05.342301 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-21bf7b57-a096-49e4-a228-4364a2f6c6f0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:05.343095 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-21bf7b57-a096-49e4-a228-4364a2f6c6f0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:05.343532 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-21bf7b57-a096-49e4-a228-4364a2f6c6f0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:05.485468 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-21bf7b57-a096-49e4-a228-4364a2f6c6f0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:05.495061 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-21bf7b57-a096-49e4-a228-4364a2f6c6f0 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1359 microversion: 2.1 time: 0.164197 Jul 19 10:01:05.495645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 976/1980] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:05 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:06.511861 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1e9ab0b6-3677-4e6d-82aa-d6d184205146 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:06.512675 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1e9ab0b6-3677-4e6d-82aa-d6d184205146 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:06.518625 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e9ab0b6-3677-4e6d-82aa-d6d184205146 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:06.519201 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e9ab0b6-3677-4e6d-82aa-d6d184205146 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:06.520043 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e9ab0b6-3677-4e6d-82aa-d6d184205146 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:06.520480 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1e9ab0b6-3677-4e6d-82aa-d6d184205146 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:06.663016 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1e9ab0b6-3677-4e6d-82aa-d6d184205146 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:06.674326 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1e9ab0b6-3677-4e6d-82aa-d6d184205146 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1359 microversion: 2.1 time: 0.166133 Jul 19 10:01:06.677956 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1005/1981] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:06 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:07.690886 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-aa292139-dee8-48f9-9f5a-35964b1b38a3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:07.691679 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-aa292139-dee8-48f9-9f5a-35964b1b38a3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:07.697511 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aa292139-dee8-48f9-9f5a-35964b1b38a3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:07.697960 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aa292139-dee8-48f9-9f5a-35964b1b38a3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:07.698720 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aa292139-dee8-48f9-9f5a-35964b1b38a3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:07.699176 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aa292139-dee8-48f9-9f5a-35964b1b38a3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:07.844083 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-aa292139-dee8-48f9-9f5a-35964b1b38a3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:07.852602 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-aa292139-dee8-48f9-9f5a-35964b1b38a3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1359 microversion: 2.1 time: 0.165776 Jul 19 10:01:07.853182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 977/1982] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:07 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:08.869074 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-d7160d49-2622-4990-b177-37afc2b534c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:08.869621 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-d7160d49-2622-4990-b177-37afc2b534c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:08.875482 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d7160d49-2622-4990-b177-37afc2b534c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:08.875936 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d7160d49-2622-4990-b177-37afc2b534c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:08.876700 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d7160d49-2622-4990-b177-37afc2b534c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:08.877137 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-d7160d49-2622-4990-b177-37afc2b534c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:09.007611 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-d7160d49-2622-4990-b177-37afc2b534c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:09.014868 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-d7160d49-2622-4990-b177-37afc2b534c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1359 microversion: 2.1 time: 0.149613 Jul 19 10:01:09.015459 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1006/1983] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:08 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:10.031782 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b3d84eed-cbc4-4db9-a204-898341924e7e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:10.032386 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b3d84eed-cbc4-4db9-a204-898341924e7e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:10.038391 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b3d84eed-cbc4-4db9-a204-898341924e7e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:10.038836 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b3d84eed-cbc4-4db9-a204-898341924e7e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:10.039624 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b3d84eed-cbc4-4db9-a204-898341924e7e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:10.040054 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b3d84eed-cbc4-4db9-a204-898341924e7e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:10.169298 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-b3d84eed-cbc4-4db9-a204-898341924e7e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:10.176463 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b3d84eed-cbc4-4db9-a204-898341924e7e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1359 microversion: 2.1 time: 0.148287 Jul 19 10:01:10.177019 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 978/1984] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:10 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:11.193227 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-34bf3335-8584-47ff-880e-99c8c5d8f44e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:11.194077 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-34bf3335-8584-47ff-880e-99c8c5d8f44e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:11.199907 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-34bf3335-8584-47ff-880e-99c8c5d8f44e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:11.200468 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-34bf3335-8584-47ff-880e-99c8c5d8f44e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:11.201425 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-34bf3335-8584-47ff-880e-99c8c5d8f44e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:11.201957 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-34bf3335-8584-47ff-880e-99c8c5d8f44e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:11.297414 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-8d52d4cd-f93e-413e-bcd0-f521b2d33922 req-7d4e4925-0bcc-4bd1-9fc9-a6daabaa1d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "709fd0d9-1ea3-4179-8451-39d39a0a4dff", "tag": "0a93879d-c358-4bd1-8879-f82adb13a143"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:01:11.300806 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 10:01:11.300806 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 10:01:11.313978 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-8d52d4cd-f93e-413e-bcd0-f521b2d33922 req-7d4e4925-0bcc-4bd1-9fc9-a6daabaa1d4f service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:11.315355 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-8d52d4cd-f93e-413e-bcd0-f521b2d33922 req-7d4e4925-0bcc-4bd1-9fc9-a6daabaa1d4f service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:11.327409 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-8d52d4cd-f93e-413e-bcd0-f521b2d33922 req-7d4e4925-0bcc-4bd1-9fc9-a6daabaa1d4f service nova] Creating event network-changed:0a93879d-c358-4bd1-8879-f82adb13a143 for instance 709fd0d9-1ea3-4179-8451-39d39a0a4dff on hv-cinder-79338 Jul 19 10:01:11.332914 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-8d52d4cd-f93e-413e-bcd0-f521b2d33922 req-7d4e4925-0bcc-4bd1-9fc9-a6daabaa1d4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039524 Jul 19 10:01:11.334075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 979/1985] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 10:01:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:01:11.359642 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-34bf3335-8584-47ff-880e-99c8c5d8f44e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:11.367624 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-34bf3335-8584-47ff-880e-99c8c5d8f44e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1359 microversion: 2.1 time: 0.178936 Jul 19 10:01:11.377995 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1007/1986] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:11 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:12.385278 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-8930fcf4-8b1c-423e-b7a4-879f926688ba tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:12.385972 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-8930fcf4-8b1c-423e-b7a4-879f926688ba tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:12.392139 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8930fcf4-8b1c-423e-b7a4-879f926688ba tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:12.392583 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8930fcf4-8b1c-423e-b7a4-879f926688ba tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:12.393975 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8930fcf4-8b1c-423e-b7a4-879f926688ba tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:12.394437 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-8930fcf4-8b1c-423e-b7a4-879f926688ba tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:12.525141 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-8930fcf4-8b1c-423e-b7a4-879f926688ba tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:12.532194 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-8930fcf4-8b1c-423e-b7a4-879f926688ba tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1359 microversion: 2.1 time: 0.151100 Jul 19 10:01:12.532773 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 980/1987] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:12 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:13.550020 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1adcd856-7b0a-4ee1-859d-4ed5370cec5d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:13.550631 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1adcd856-7b0a-4ee1-859d-4ed5370cec5d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:13.556337 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1adcd856-7b0a-4ee1-859d-4ed5370cec5d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:13.556790 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1adcd856-7b0a-4ee1-859d-4ed5370cec5d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:13.557555 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1adcd856-7b0a-4ee1-859d-4ed5370cec5d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:13.557988 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1adcd856-7b0a-4ee1-859d-4ed5370cec5d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:13.689276 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1adcd856-7b0a-4ee1-859d-4ed5370cec5d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:13.696489 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1adcd856-7b0a-4ee1-859d-4ed5370cec5d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1359 microversion: 2.1 time: 0.150633 Jul 19 10:01:13.697042 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1008/1988] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:13 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:14.713027 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e3eb4a97-c2a7-4781-8a18-ab29157d0c55 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:14.713657 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e3eb4a97-c2a7-4781-8a18-ab29157d0c55 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:14.719483 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e3eb4a97-c2a7-4781-8a18-ab29157d0c55 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:14.719926 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e3eb4a97-c2a7-4781-8a18-ab29157d0c55 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:14.721195 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e3eb4a97-c2a7-4781-8a18-ab29157d0c55 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:14.721604 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e3eb4a97-c2a7-4781-8a18-ab29157d0c55 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:14.854482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e3eb4a97-c2a7-4781-8a18-ab29157d0c55 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:14.861673 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e3eb4a97-c2a7-4781-8a18-ab29157d0c55 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1359 microversion: 2.1 time: 0.152527 Jul 19 10:01:14.862223 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 981/1989] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:14 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:15.582331 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-dee3062a-77ad-4c24-b223-53ebbbf37e73 req-7daed433-b618-433a-b6ff-45f743fd28ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "709fd0d9-1ea3-4179-8451-39d39a0a4dff", "name": "network-vif-plugged", "status": "completed", "tag": "0a93879d-c358-4bd1-8879-f82adb13a143"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:01:15.584119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 10:01:15.584119 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 10:01:15.591234 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-dee3062a-77ad-4c24-b223-53ebbbf37e73 req-7daed433-b618-433a-b6ff-45f743fd28ae service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:15.591701 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-dee3062a-77ad-4c24-b223-53ebbbf37e73 req-7daed433-b618-433a-b6ff-45f743fd28ae service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:15.603664 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-dee3062a-77ad-4c24-b223-53ebbbf37e73 req-7daed433-b618-433a-b6ff-45f743fd28ae service nova] Creating event network-vif-plugged:0a93879d-c358-4bd1-8879-f82adb13a143 for instance 709fd0d9-1ea3-4179-8451-39d39a0a4dff on hv-cinder-79338 Jul 19 10:01:15.608686 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-dee3062a-77ad-4c24-b223-53ebbbf37e73 req-7daed433-b618-433a-b6ff-45f743fd28ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030482 Jul 19 10:01:15.609256 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1009/1990] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 10:01:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:01:15.878062 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-e21e622f-a0aa-4d4f-bc57-0469514a84f4 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:15.878705 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-e21e622f-a0aa-4d4f-bc57-0469514a84f4 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:15.884526 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e21e622f-a0aa-4d4f-bc57-0469514a84f4 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:15.884977 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e21e622f-a0aa-4d4f-bc57-0469514a84f4 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:15.885755 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e21e622f-a0aa-4d4f-bc57-0469514a84f4 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:15.886190 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-e21e622f-a0aa-4d4f-bc57-0469514a84f4 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:16.014055 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-e21e622f-a0aa-4d4f-bc57-0469514a84f4 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:16.021741 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-e21e622f-a0aa-4d4f-bc57-0469514a84f4 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1359 microversion: 2.1 time: 0.148071 Jul 19 10:01:16.022290 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 982/1991] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:15 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:17.038876 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b7b5164b-5c07-4829-b965-f25bbc93d922 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:17.039604 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b7b5164b-5c07-4829-b965-f25bbc93d922 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:17.045676 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7b5164b-5c07-4829-b965-f25bbc93d922 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:17.046124 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7b5164b-5c07-4829-b965-f25bbc93d922 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:17.046889 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7b5164b-5c07-4829-b965-f25bbc93d922 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:17.047351 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b7b5164b-5c07-4829-b965-f25bbc93d922 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:17.178902 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b7b5164b-5c07-4829-b965-f25bbc93d922 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:17.186156 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b7b5164b-5c07-4829-b965-f25bbc93d922 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1549 microversion: 2.1 time: 0.151563 Jul 19 10:01:17.186714 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1010/1992] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:17 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:17.201708 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-1eb572b7-00fb-4824-b492-36d41c68dba3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:17.202321 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-1eb572b7-00fb-4824-b492-36d41c68dba3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:17.208530 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1eb572b7-00fb-4824-b492-36d41c68dba3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:17.208982 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1eb572b7-00fb-4824-b492-36d41c68dba3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:17.209749 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1eb572b7-00fb-4824-b492-36d41c68dba3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:17.210186 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-1eb572b7-00fb-4824-b492-36d41c68dba3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:17.343246 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-1eb572b7-00fb-4824-b492-36d41c68dba3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:17.351075 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-1eb572b7-00fb-4824-b492-36d41c68dba3 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1549 microversion: 2.1 time: 0.152990 Jul 19 10:01:17.351645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 983/1993] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:17 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:17.372526 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-b20b0879-a848-451d-93d6-96124f2dba4a tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:17.372526 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 10:01:17.372526 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 10:01:17.372526 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-b20b0879-a848-451d-93d6-96124f2dba4a tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:17.372526 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-b20b0879-a848-451d-93d6-96124f2dba4a tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Searching by: {'deleted': False, 'project_id': '3116e7df5a2642949510b33d79e0bedf'} {{(pid=107463) get_all /opt/stack/nova/nova/compute/api.py:2835}} Jul 19 10:01:17.379422 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b20b0879-a848-451d-93d6-96124f2dba4a tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:17.379859 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b20b0879-a848-451d-93d6-96124f2dba4a tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:17.380646 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b20b0879-a848-451d-93d6-96124f2dba4a tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:17.381072 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-b20b0879-a848-451d-93d6-96124f2dba4a tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:17.466987 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.multi_cell_list [None req-b20b0879-a848-451d-93d6-96124f2dba4a tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=107463) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Jul 19 10:01:17.559393 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-b20b0879-a848-451d-93d6-96124f2dba4a tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.196155 Jul 19 10:01:17.559878 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1011/1994] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Jul 19 10:01:17 2021] GET /compute/v2.1/servers => generated 343 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:01:17.569706 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-223a936a-0cab-414b-9036-76bf8c654cdd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:17.570316 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-223a936a-0cab-414b-9036-76bf8c654cdd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:17.576054 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-223a936a-0cab-414b-9036-76bf8c654cdd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:17.576502 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-223a936a-0cab-414b-9036-76bf8c654cdd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:17.577262 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-223a936a-0cab-414b-9036-76bf8c654cdd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:17.577698 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-223a936a-0cab-414b-9036-76bf8c654cdd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:17.708385 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-223a936a-0cab-414b-9036-76bf8c654cdd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:17.715577 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-223a936a-0cab-414b-9036-76bf8c654cdd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1549 microversion: 2.1 time: 0.149500 Jul 19 10:01:17.716137 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 984/1995] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:17 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:19.215890 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-762dc0e3-d5c0-43c9-875d-aa42a33ac70b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fe8fbcf-b45e-442e-acd6-550a894af5e6"}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:01:19.217044 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-762dc0e3-d5c0-43c9-875d-aa42a33ac70b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:19.223589 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-762dc0e3-d5c0-43c9-875d-aa42a33ac70b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:19.224047 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-762dc0e3-d5c0-43c9-875d-aa42a33ac70b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:19.224808 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-762dc0e3-d5c0-43c9-875d-aa42a33ac70b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:19.225268 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-762dc0e3-d5c0-43c9-875d-aa42a33ac70b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:19.453193 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-762dc0e3-d5c0-43c9-875d-aa42a33ac70b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "POST /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240356 Jul 19 10:01:19.453991 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1012/1996] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Jul 19 10:01:19 2021] POST /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:01:27.012601 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-cc25c4dd-ea0a-417f-992e-f0c60f960802 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:27.013218 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-cc25c4dd-ea0a-417f-992e-f0c60f960802 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:27.019099 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc25c4dd-ea0a-417f-992e-f0c60f960802 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:27.019552 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc25c4dd-ea0a-417f-992e-f0c60f960802 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:27.020319 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc25c4dd-ea0a-417f-992e-f0c60f960802 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:27.020757 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-cc25c4dd-ea0a-417f-992e-f0c60f960802 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:27.150016 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-cc25c4dd-ea0a-417f-992e-f0c60f960802 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:27.158377 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-cc25c4dd-ea0a-417f-992e-f0c60f960802 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1595 microversion: 2.1 time: 0.148858 Jul 19 10:01:27.158940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 985/1997] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:27 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1595 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:29.200616 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-bcead75e-87de-445a-8c4e-654a478295ee req-6b3c0a0e-2447-41ee-92a7-1180c94f245b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "709fd0d9-1ea3-4179-8451-39d39a0a4dff", "tag": "0a93879d-c358-4bd1-8879-f82adb13a143"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:01:29.202832 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 10:01:29.202832 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 10:01:29.210761 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-bcead75e-87de-445a-8c4e-654a478295ee req-6b3c0a0e-2447-41ee-92a7-1180c94f245b service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:29.211242 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-bcead75e-87de-445a-8c4e-654a478295ee req-6b3c0a0e-2447-41ee-92a7-1180c94f245b service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:29.221651 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-bcead75e-87de-445a-8c4e-654a478295ee req-6b3c0a0e-2447-41ee-92a7-1180c94f245b service nova] Creating event network-changed:0a93879d-c358-4bd1-8879-f82adb13a143 for instance 709fd0d9-1ea3-4179-8451-39d39a0a4dff on hv-cinder-79338 Jul 19 10:01:29.227131 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-bcead75e-87de-445a-8c4e-654a478295ee req-6b3c0a0e-2447-41ee-92a7-1180c94f245b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165148 Jul 19 10:01:29.227807 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1013/1998] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 10:01:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:01:30.131019 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-b2f0b581-41e0-40f4-8a9c-304bc70bbd98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-835292744"}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:01:30.131571 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-b2f0b581-41e0-40f4-8a9c-304bc70bbd98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:30.137435 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b2f0b581-41e0-40f4-8a9c-304bc70bbd98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:30.137888 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b2f0b581-41e0-40f4-8a9c-304bc70bbd98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:30.138655 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b2f0b581-41e0-40f4-8a9c-304bc70bbd98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:30.139127 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-b2f0b581-41e0-40f4-8a9c-304bc70bbd98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:30.273226 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.network.security_group_api [None req-b2f0b581-41e0-40f4-8a9c-304bc70bbd98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Adding security group 7ac59901-b389-4375-8beb-ed4603221ee0 to port 0a93879d-c358-4bd1-8879-f82adb13a143 Jul 19 10:01:30.600616 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-b2f0b581-41e0-40f4-8a9c-304bc70bbd98 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "POST /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/action" status: 202 len: 0 microversion: 2.1 time: 0.473818 Jul 19 10:01:30.601404 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 986/1999] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 10:01:30 2021] POST /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 10:01:30.609900 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1f48eade-3e6f-4138-9394-356aba8f03bb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:30.610603 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-1f48eade-3e6f-4138-9394-356aba8f03bb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:30.619307 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1f48eade-3e6f-4138-9394-356aba8f03bb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:30.619771 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1f48eade-3e6f-4138-9394-356aba8f03bb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:30.620554 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1f48eade-3e6f-4138-9394-356aba8f03bb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:30.621182 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-1f48eade-3e6f-4138-9394-356aba8f03bb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:30.841619 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-1f48eade-3e6f-4138-9394-356aba8f03bb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:30.850474 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1f48eade-3e6f-4138-9394-356aba8f03bb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1760 microversion: 2.1 time: 0.244675 Jul 19 10:01:30.851155 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1014/2000] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:30 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1760 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:31.245138 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-4a0512bf-a7c6-4968-b7ca-862476fda0c8 req-afcfa438-cfe9-4714-ac08-f2c405b8cb5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "709fd0d9-1ea3-4179-8451-39d39a0a4dff", "tag": "0a93879d-c358-4bd1-8879-f82adb13a143"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:01:31.246694 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 10:01:31.246694 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 10:01:31.254228 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-4a0512bf-a7c6-4968-b7ca-862476fda0c8 req-afcfa438-cfe9-4714-ac08-f2c405b8cb5d service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:31.254672 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-4a0512bf-a7c6-4968-b7ca-862476fda0c8 req-afcfa438-cfe9-4714-ac08-f2c405b8cb5d service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:31.265712 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-4a0512bf-a7c6-4968-b7ca-862476fda0c8 req-afcfa438-cfe9-4714-ac08-f2c405b8cb5d service nova] Creating event network-changed:0a93879d-c358-4bd1-8879-f82adb13a143 for instance 709fd0d9-1ea3-4179-8451-39d39a0a4dff on hv-cinder-79338 Jul 19 10:01:31.270801 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-4a0512bf-a7c6-4968-b7ca-862476fda0c8 req-afcfa438-cfe9-4714-ac08-f2c405b8cb5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029160 Jul 19 10:01:31.271339 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 987/2001] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 10:01:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:01:47.898657 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f5e0d9a0-c4bf-42fd-98cd-db7342635379 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:01:47.899832 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-f5e0d9a0-c4bf-42fd-98cd-db7342635379 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:47.906204 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5e0d9a0-c4bf-42fd-98cd-db7342635379 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:47.906780 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5e0d9a0-c4bf-42fd-98cd-db7342635379 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:47.907806 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5e0d9a0-c4bf-42fd-98cd-db7342635379 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:47.908897 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-f5e0d9a0-c4bf-42fd-98cd-db7342635379 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:47.978291 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f5e0d9a0-c4bf-42fd-98cd-db7342635379 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "POST /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/action" status: 202 len: 0 microversion: 2.1 time: 0.083249 Jul 19 10:01:47.982117 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1015/2002] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 10:01:47 2021] POST /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 10:01:47.987623 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-527ee065-787e-49e3-b1d6-d0551cc77871 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:47.988419 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-527ee065-787e-49e3-b1d6-d0551cc77871 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:47.994468 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-527ee065-787e-49e3-b1d6-d0551cc77871 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:47.994917 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-527ee065-787e-49e3-b1d6-d0551cc77871 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:47.995738 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-527ee065-787e-49e3-b1d6-d0551cc77871 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:47.996231 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-527ee065-787e-49e3-b1d6-d0551cc77871 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:48.202561 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-527ee065-787e-49e3-b1d6-d0551cc77871 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:48.210881 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-527ee065-787e-49e3-b1d6-d0551cc77871 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1752 microversion: 2.1 time: 0.227295 Jul 19 10:01:48.211483 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 988/2003] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:47 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1752 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 10:01:49.228463 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c989d6f3-e830-4a7c-95cf-4e29da38d0c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:49.229151 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c989d6f3-e830-4a7c-95cf-4e29da38d0c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:49.235140 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c989d6f3-e830-4a7c-95cf-4e29da38d0c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:49.235614 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c989d6f3-e830-4a7c-95cf-4e29da38d0c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:49.236366 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c989d6f3-e830-4a7c-95cf-4e29da38d0c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:49.236794 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c989d6f3-e830-4a7c-95cf-4e29da38d0c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:49.367670 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c989d6f3-e830-4a7c-95cf-4e29da38d0c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:49.375255 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c989d6f3-e830-4a7c-95cf-4e29da38d0c9 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1757 microversion: 2.1 time: 0.150781 Jul 19 10:01:49.375824 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1016/2004] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:49 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1757 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:50.392894 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-ba92cb00-2968-4880-a5fb-1d12b10041ce tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:50.393524 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-ba92cb00-2968-4880-a5fb-1d12b10041ce tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:50.399471 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba92cb00-2968-4880-a5fb-1d12b10041ce tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:50.399921 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba92cb00-2968-4880-a5fb-1d12b10041ce tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:50.400690 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba92cb00-2968-4880-a5fb-1d12b10041ce tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:50.401127 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-ba92cb00-2968-4880-a5fb-1d12b10041ce tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:50.536267 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-ba92cb00-2968-4880-a5fb-1d12b10041ce tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:50.544258 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-ba92cb00-2968-4880-a5fb-1d12b10041ce tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1757 microversion: 2.1 time: 0.155627 Jul 19 10:01:50.544830 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 989/2005] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:50 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1757 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:51.560952 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4fdade49-5f74-4d6f-957e-e99b0476cafb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:51.561582 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-4fdade49-5f74-4d6f-957e-e99b0476cafb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:51.567299 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4fdade49-5f74-4d6f-957e-e99b0476cafb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:51.567744 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4fdade49-5f74-4d6f-957e-e99b0476cafb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:51.568497 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4fdade49-5f74-4d6f-957e-e99b0476cafb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:51.568989 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-4fdade49-5f74-4d6f-957e-e99b0476cafb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:51.703411 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-4fdade49-5f74-4d6f-957e-e99b0476cafb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:51.711417 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4fdade49-5f74-4d6f-957e-e99b0476cafb tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1757 microversion: 2.1 time: 0.154094 Jul 19 10:01:51.711979 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1017/2006] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:51 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1757 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:52.728798 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-847dafd6-c7c8-4b44-acd4-6adaa75cbe5e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:52.729439 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-847dafd6-c7c8-4b44-acd4-6adaa75cbe5e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:52.735237 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-847dafd6-c7c8-4b44-acd4-6adaa75cbe5e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:52.735693 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-847dafd6-c7c8-4b44-acd4-6adaa75cbe5e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:52.736461 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-847dafd6-c7c8-4b44-acd4-6adaa75cbe5e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:52.736895 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-847dafd6-c7c8-4b44-acd4-6adaa75cbe5e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:52.870785 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-847dafd6-c7c8-4b44-acd4-6adaa75cbe5e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:52.879012 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-847dafd6-c7c8-4b44-acd4-6adaa75cbe5e tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1757 microversion: 2.1 time: 0.153874 Jul 19 10:01:52.879592 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 990/2007] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:52 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1757 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:53.895743 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-bbed94ac-46ce-466a-a909-ed1beecfd379 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:53.896352 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-bbed94ac-46ce-466a-a909-ed1beecfd379 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:53.902526 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbed94ac-46ce-466a-a909-ed1beecfd379 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:53.902973 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbed94ac-46ce-466a-a909-ed1beecfd379 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:53.903760 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbed94ac-46ce-466a-a909-ed1beecfd379 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:53.904191 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-bbed94ac-46ce-466a-a909-ed1beecfd379 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:54.035030 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-bbed94ac-46ce-466a-a909-ed1beecfd379 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:54.042899 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-bbed94ac-46ce-466a-a909-ed1beecfd379 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1757 microversion: 2.1 time: 0.151436 Jul 19 10:01:54.043492 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1018/2008] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:53 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1757 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:55.059921 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c775cb2e-f9be-491d-9a0c-8e02c173678b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:55.060534 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-c775cb2e-f9be-491d-9a0c-8e02c173678b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:55.066397 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c775cb2e-f9be-491d-9a0c-8e02c173678b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:55.066843 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c775cb2e-f9be-491d-9a0c-8e02c173678b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:55.067626 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c775cb2e-f9be-491d-9a0c-8e02c173678b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:55.068056 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-c775cb2e-f9be-491d-9a0c-8e02c173678b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:55.201689 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-c775cb2e-f9be-491d-9a0c-8e02c173678b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:55.209847 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c775cb2e-f9be-491d-9a0c-8e02c173678b tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1757 microversion: 2.1 time: 0.153619 Jul 19 10:01:55.210401 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 991/2009] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:55 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1757 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:56.226770 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-a87fabee-42a4-4503-b3a3-52f8a444ed89 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:56.227437 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-a87fabee-42a4-4503-b3a3-52f8a444ed89 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:56.233247 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a87fabee-42a4-4503-b3a3-52f8a444ed89 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:56.233696 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a87fabee-42a4-4503-b3a3-52f8a444ed89 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:56.234453 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a87fabee-42a4-4503-b3a3-52f8a444ed89 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:56.234884 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-a87fabee-42a4-4503-b3a3-52f8a444ed89 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:56.366835 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-a87fabee-42a4-4503-b3a3-52f8a444ed89 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:56.374459 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-a87fabee-42a4-4503-b3a3-52f8a444ed89 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1757 microversion: 2.1 time: 0.151454 Jul 19 10:01:56.375059 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1019/2010] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:56 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1757 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:57.392372 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-5a3a34f6-6e14-4ee0-bbd7-39240a68a559 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:57.393431 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-5a3a34f6-6e14-4ee0-bbd7-39240a68a559 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:57.399437 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5a3a34f6-6e14-4ee0-bbd7-39240a68a559 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:57.399880 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5a3a34f6-6e14-4ee0-bbd7-39240a68a559 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:57.400639 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5a3a34f6-6e14-4ee0-bbd7-39240a68a559 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:57.401065 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-5a3a34f6-6e14-4ee0-bbd7-39240a68a559 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:57.537427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-5a3a34f6-6e14-4ee0-bbd7-39240a68a559 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:57.545270 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-5a3a34f6-6e14-4ee0-bbd7-39240a68a559 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1757 microversion: 2.1 time: 0.157561 Jul 19 10:01:57.545825 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 992/2011] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:57 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:58.348706 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-046b5322-2bc5-41c0-8439-f7ca71ed24ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:58.349224 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-046b5322-2bc5-41c0-8439-f7ca71ed24ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:58.355016 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-046b5322-2bc5-41c0-8439-f7ca71ed24ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:58.355488 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-046b5322-2bc5-41c0-8439-f7ca71ed24ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:58.356248 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-046b5322-2bc5-41c0-8439-f7ca71ed24ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:58.356683 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-046b5322-2bc5-41c0-8439-f7ca71ed24ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:58.370168 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-046b5322-2bc5-41c0-8439-f7ca71ed24ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] HTTP exception thrown: Instance 5bff3c23-e302-4420-a1fd-58fd8e80c1a1 could not be found. Jul 19 10:01:58.370743 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-046b5322-2bc5-41c0-8439-f7ca71ed24ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Returning 404 to user: Instance 5bff3c23-e302-4420-a1fd-58fd8e80c1a1 could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 10:01:58.371574 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-046b5322-2bc5-41c0-8439-f7ca71ed24ce tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 404 len: 111 microversion: 2.1 time: 0.026619 Jul 19 10:01:58.372086 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1020/2012] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 10:01:58 2021] DELETE /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 10:01:58.380233 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-713b4e63-73a4-4596-95d5-35a39ab579ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:58.380835 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-713b4e63-73a4-4596-95d5-35a39ab579ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] [instance: 5bff3c23-e302-4420-a1fd-58fd8e80c1a1] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:58.386437 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-713b4e63-73a4-4596-95d5-35a39ab579ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:58.386885 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-713b4e63-73a4-4596-95d5-35a39ab579ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:58.387680 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-713b4e63-73a4-4596-95d5-35a39ab579ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:58.388108 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-713b4e63-73a4-4596-95d5-35a39ab579ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:58.401169 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-713b4e63-73a4-4596-95d5-35a39ab579ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] HTTP exception thrown: Instance 5bff3c23-e302-4420-a1fd-58fd8e80c1a1 could not be found. Jul 19 10:01:58.401738 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-713b4e63-73a4-4596-95d5-35a39ab579ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] Returning 404 to user: Instance 5bff3c23-e302-4420-a1fd-58fd8e80c1a1 could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 10:01:58.402518 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-713b4e63-73a4-4596-95d5-35a39ab579ad tempest-AttachVolumeTestJSON-1362397745 tempest-AttachVolumeTestJSON-1362397745-project] 10.222.0.16 "GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1" status: 404 len: 111 microversion: 2.1 time: 0.026590 Jul 19 10:01:58.403017 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 993/2013] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:58 2021] GET /compute/v2.1/servers/5bff3c23-e302-4420-a1fd-58fd8e80c1a1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 10:01:58.561421 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-8facb5ba-316f-4cb9-ae24-996f7b194343 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:58.562055 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-8facb5ba-316f-4cb9-ae24-996f7b194343 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:58.568609 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8facb5ba-316f-4cb9-ae24-996f7b194343 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:58.569067 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8facb5ba-316f-4cb9-ae24-996f7b194343 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:58.569834 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8facb5ba-316f-4cb9-ae24-996f7b194343 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:58.570268 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-8facb5ba-316f-4cb9-ae24-996f7b194343 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:58.705125 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-8facb5ba-316f-4cb9-ae24-996f7b194343 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:01:58.712929 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-8facb5ba-316f-4cb9-ae24-996f7b194343 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1757 microversion: 2.1 time: 0.155176 Jul 19 10:01:58.713498 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1021/2014] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:58 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1757 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:01:59.730436 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-835af45a-9efc-4f91-9b25-72cfbf914448 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:01:59.731290 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-835af45a-9efc-4f91-9b25-72cfbf914448 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:01:59.736976 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-835af45a-9efc-4f91-9b25-72cfbf914448 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:59.737425 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-835af45a-9efc-4f91-9b25-72cfbf914448 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:01:59.738197 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-835af45a-9efc-4f91-9b25-72cfbf914448 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:01:59.738658 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-835af45a-9efc-4f91-9b25-72cfbf914448 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:00.230374 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-835af45a-9efc-4f91-9b25-72cfbf914448 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:02:00.238439 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-835af45a-9efc-4f91-9b25-72cfbf914448 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1760 microversion: 2.1 time: 0.511704 Jul 19 10:02:00.255772 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 994/2015] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:01:59 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1760 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:02:02.781290 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-42dc7678-a0a5-4dc1-85b1-c01c20467b96 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Action: 'create', calling method: .version_select at 0x7f04b03b2e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-154911900"}} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:02:03.060060 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-42dc7678-a0a5-4dc1-85b1-c01c20467b96 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.383653 Jul 19 10:02:03.060681 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1022/2016] 10.222.0.16 () {60 vars in 1155 bytes} [Mon Jul 19 10:02:02 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 385 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 19 10:02:03.071354 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-31e6d68b-fc84-4dc9-9d52-6be11f0539d2 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b0241670>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:03.127614 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-31e6d68b-fc84-4dc9-9d52-6be11f0539d2 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fe6cf231-f936-47a5-8d40-fdf89112f5ce" status: 200 len: 344 microversion: 2.1 time: 0.059783 Jul 19 10:02:03.128182 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 995/2017] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Jul 19 10:02:03 2021] GET /compute/v2.1/os-volumes/fe6cf231-f936-47a5-8d40-fdf89112f5ce => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:02:04.138857 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-22a607da-893b-4b7e-adc1-0611a643e0b9 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b05411f0>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:04.189463 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-22a607da-893b-4b7e-adc1-0611a643e0b9 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fe6cf231-f936-47a5-8d40-fdf89112f5ce" status: 200 len: 345 microversion: 2.1 time: 0.054212 Jul 19 10:02:04.190983 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1023/2018] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Jul 19 10:02:04 2021] GET /compute/v2.1/os-volumes/fe6cf231-f936-47a5-8d40-fdf89112f5ce => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:02:04.201554 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d5e2ebed-27c6-4d5b-97e8-d31dcce87029 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Action: 'create', calling method: .version_select at 0x7f04b0241280>, body: {"snapshot": {"volume_id": "fe6cf231-f936-47a5-8d40-fdf89112f5ce", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-797491382"}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:02:04.335987 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d5e2ebed-27c6-4d5b-97e8-d31dcce87029 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.137948 Jul 19 10:02:04.336565 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 996/2019] 10.222.0.16 () {60 vars in 1162 bytes} [Mon Jul 19 10:02:04 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:02:04.345897 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-71675b3c-3562-4700-8e65-ecb1b285a1ec tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b028c3a0>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:04.377707 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-71675b3c-3562-4700-8e65-ecb1b285a1ec tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2" status: 200 len: 286 microversion: 2.1 time: 0.035260 Jul 19 10:02:04.378935 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1024/2020] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Jul 19 10:02:04 2021] GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:02:04.388299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6c66f5f7-47b4-48f9-a123-5ce98cbc227f tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b02e9f70>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:04.417330 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6c66f5f7-47b4-48f9-a123-5ce98cbc227f tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032578 Jul 19 10:02:04.417901 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 997/2021] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Jul 19 10:02:04 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 10:02:04.427743 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4a0e34f8-b62f-4a50-b401-e3f893752200 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b028c670>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:04.456127 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4a0e34f8-b62f-4a50-b401-e3f893752200 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2" status: 200 len: 286 microversion: 2.1 time: 0.032412 Jul 19 10:02:04.456672 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1025/2022] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Jul 19 10:02:04 2021] GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:02:05.467349 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-df9342a3-92a6-4d4c-9b9d-1958dd40b9da tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b0294e50>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:05.495277 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-df9342a3-92a6-4d4c-9b9d-1958dd40b9da tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2" status: 200 len: 286 microversion: 2.1 time: 0.031579 Jul 19 10:02:05.495827 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 998/2023] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Jul 19 10:02:05 2021] GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:02:06.506686 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-f7d63024-0b7c-42b0-b713-ecf4464f89df tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b04784c0>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:06.536311 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-f7d63024-0b7c-42b0-b713-ecf4464f89df tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2" status: 200 len: 286 microversion: 2.1 time: 0.033313 Jul 19 10:02:06.537133 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1026/2024] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Jul 19 10:02:06 2021] GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:02:07.548045 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-6832a089-1048-4ff0-aa84-bba87e5f09ef tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b0241f70>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:07.577647 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-6832a089-1048-4ff0-aa84-bba87e5f09ef tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2" status: 200 len: 286 microversion: 2.1 time: 0.033244 Jul 19 10:02:07.578188 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 999/2025] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Jul 19 10:02:07 2021] GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:02:08.588861 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-1b744ca4-4abd-4b98-a829-5112370bd1aa tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b01e0af0>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:08.617240 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-1b744ca4-4abd-4b98-a829-5112370bd1aa tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2" status: 200 len: 287 microversion: 2.1 time: 0.032017 Jul 19 10:02:08.617784 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1027/2026] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Jul 19 10:02:08 2021] GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:02:08.627940 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-fa9fbe9c-fa2b-4543-8a83-01604257dbf9 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b026dee0>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:08.681039 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-fa9fbe9c-fa2b-4543-8a83-01604257dbf9 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2" status: 202 len: 0 microversion: 2.1 time: 0.057136 Jul 19 10:02:08.681583 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 1000/2027] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Jul 19 10:02:08 2021] DELETE /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 10:02:08.689272 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-db14c420-31aa-4c98-8987-9d4fb9b2b176 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b0412d30>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:08.718398 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-db14c420-31aa-4c98-8987-9d4fb9b2b176 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2" status: 200 len: 286 microversion: 2.1 time: 0.032660 Jul 19 10:02:08.718941 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1028/2028] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Jul 19 10:02:08 2021] GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 10:02:09.731229 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d5583f91-23ac-462b-a5bd-9a4865c8a354 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b01edaf0>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:09.756347 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-d5583f91-23ac-462b-a5bd-9a4865c8a354 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] HTTP exception thrown: Snapshot 31cbb69f-ec21-48cb-aa47-b2bb1627c6a2 could not be found. Jul 19 10:02:09.756939 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-d5583f91-23ac-462b-a5bd-9a4865c8a354 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Returning 404 to user: Snapshot 31cbb69f-ec21-48cb-aa47-b2bb1627c6a2 could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 10:02:09.757753 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-d5583f91-23ac-462b-a5bd-9a4865c8a354 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2" status: 404 len: 111 microversion: 2.1 time: 0.030252 Jul 19 10:02:09.758292 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 1001/2029] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Jul 19 10:02:09 2021] GET /compute/v2.1/os-snapshots/31cbb69f-ec21-48cb-aa47-b2bb1627c6a2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 10:02:09.765961 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-0819c7e3-dfc1-4d7c-9003-bab1dee8a1d3 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b03b2e50>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:09.822542 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-0819c7e3-dfc1-4d7c-9003-bab1dee8a1d3 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/fe6cf231-f936-47a5-8d40-fdf89112f5ce" status: 202 len: 0 microversion: 2.1 time: 0.060076 Jul 19 10:02:09.823129 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1029/2030] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Jul 19 10:02:09 2021] DELETE /compute/v2.1/os-volumes/fe6cf231-f936-47a5-8d40-fdf89112f5ce => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 10:02:09.830954 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-c2c258fa-efde-4c64-8636-43da8b6e9c2e tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b02e9c10>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:09.882512 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-c2c258fa-efde-4c64-8636-43da8b6e9c2e tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fe6cf231-f936-47a5-8d40-fdf89112f5ce" status: 200 len: 344 microversion: 2.1 time: 0.055172 Jul 19 10:02:09.883089 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 1002/2031] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Jul 19 10:02:09 2021] GET /compute/v2.1/os-volumes/fe6cf231-f936-47a5-8d40-fdf89112f5ce => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 10:02:10.895217 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4cc868c8-61b2-4bba-88c6-8b236dbd55f9 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b0541820>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:10.921915 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-4cc868c8-61b2-4bba-88c6-8b236dbd55f9 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] HTTP exception thrown: Volume fe6cf231-f936-47a5-8d40-fdf89112f5ce could not be found. Jul 19 10:02:10.922491 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-4cc868c8-61b2-4bba-88c6-8b236dbd55f9 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Returning 404 to user: Volume fe6cf231-f936-47a5-8d40-fdf89112f5ce could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 10:02:10.923318 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-4cc868c8-61b2-4bba-88c6-8b236dbd55f9 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fe6cf231-f936-47a5-8d40-fdf89112f5ce" status: 404 len: 109 microversion: 2.1 time: 0.032415 Jul 19 10:02:10.923851 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1030/2032] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Jul 19 10:02:10 2021] GET /compute/v2.1/os-volumes/fe6cf231-f936-47a5-8d40-fdf89112f5ce => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 10:02:10.937662 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2e8b8aa7-43ff-4a26-9f38-1124bbfa0350 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b026dee0>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:10.965219 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-2e8b8aa7-43ff-4a26-9f38-1124bbfa0350 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] HTTP exception thrown: Volume fe6cf231-f936-47a5-8d40-fdf89112f5ce could not be found. Jul 19 10:02:10.965809 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-2e8b8aa7-43ff-4a26-9f38-1124bbfa0350 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Returning 404 to user: Volume fe6cf231-f936-47a5-8d40-fdf89112f5ce could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 10:02:10.966645 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-2e8b8aa7-43ff-4a26-9f38-1124bbfa0350 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/fe6cf231-f936-47a5-8d40-fdf89112f5ce" status: 404 len: 109 microversion: 2.1 time: 0.032801 Jul 19 10:02:10.967210 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 1003/2033] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Jul 19 10:02:10 2021] DELETE /compute/v2.1/os-volumes/fe6cf231-f936-47a5-8d40-fdf89112f5ce => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 10:02:10.974502 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-31116291-c33d-42cb-b870-6b18138fcfc0 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Calling method '.version_select at 0x7f04b04784c0>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:11.000953 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.wsgi [None req-31116291-c33d-42cb-b870-6b18138fcfc0 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] HTTP exception thrown: Volume fe6cf231-f936-47a5-8d40-fdf89112f5ce could not be found. Jul 19 10:02:11.001523 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-31116291-c33d-42cb-b870-6b18138fcfc0 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] Returning 404 to user: Volume fe6cf231-f936-47a5-8d40-fdf89112f5ce could not be found. {{(pid=107463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 10:02:11.002317 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-31116291-c33d-42cb-b870-6b18138fcfc0 tempest-VolumesSnapshotsTestJSON-2129302227 tempest-VolumesSnapshotsTestJSON-2129302227-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fe6cf231-f936-47a5-8d40-fdf89112f5ce" status: 404 len: 109 microversion: 2.1 time: 0.031341 Jul 19 10:02:11.002818 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1031/2034] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Jul 19 10:02:10 2021] GET /compute/v2.1/os-volumes/fe6cf231-f936-47a5-8d40-fdf89112f5ce => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 10:02:14.321122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 10:02:14.321620 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 10:02:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 10:02:17.307992 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 10:02:17.308435 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 10:02:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 10:02:32.651849 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-32d6bb9f-7937-4b3f-9df7-022e75fe7faa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-835292744"}} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:02:32.652397 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-32d6bb9f-7937-4b3f-9df7-022e75fe7faa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:02:32.654428 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 19 10:02:32.658794 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32d6bb9f-7937-4b3f-9df7-022e75fe7faa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:32.659285 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32d6bb9f-7937-4b3f-9df7-022e75fe7faa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:32.660059 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32d6bb9f-7937-4b3f-9df7-022e75fe7faa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:32.660492 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-32d6bb9f-7937-4b3f-9df7-022e75fe7faa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:32.787713 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.network.security_group_api [None req-32d6bb9f-7937-4b3f-9df7-022e75fe7faa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Removing security group 7ac59901-b389-4375-8beb-ed4603221ee0 from port 0a93879d-c358-4bd1-8879-f82adb13a143 Jul 19 10:02:33.131427 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-32d6bb9f-7937-4b3f-9df7-022e75fe7faa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "POST /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/action" status: 202 len: 0 microversion: 2.1 time: 0.483326 Jul 19 10:02:33.132274 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 1004/2035] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Jul 19 10:02:32 2021] POST /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 10:02:33.142840 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-f623f87e-0d1b-4d99-990c-3ed74beca26e req-324d7b2e-55b9-4e7c-b9c5-2d9b637ec22b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "709fd0d9-1ea3-4179-8451-39d39a0a4dff", "tag": "0a93879d-c358-4bd1-8879-f82adb13a143"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:02:33.144509 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 10:02:33.144509 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 10:02:33.160239 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-f623f87e-0d1b-4d99-990c-3ed74beca26e req-324d7b2e-55b9-4e7c-b9c5-2d9b637ec22b service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:33.160770 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-f623f87e-0d1b-4d99-990c-3ed74beca26e req-324d7b2e-55b9-4e7c-b9c5-2d9b637ec22b service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:33.182127 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-f623f87e-0d1b-4d99-990c-3ed74beca26e req-324d7b2e-55b9-4e7c-b9c5-2d9b637ec22b service nova] Creating event network-changed:0a93879d-c358-4bd1-8879-f82adb13a143 for instance 709fd0d9-1ea3-4179-8451-39d39a0a4dff on hv-cinder-79338 Jul 19 10:02:33.187919 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-f623f87e-0d1b-4d99-990c-3ed74beca26e req-324d7b2e-55b9-4e7c-b9c5-2d9b637ec22b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049762 Jul 19 10:02:33.191513 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1032/2036] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 10:02:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:02:34.407299 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-628c5a75-f8d5-48b5-a6c3-ad67a46caebd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:34.408391 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-628c5a75-f8d5-48b5-a6c3-ad67a46caebd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:02:34.430609 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-628c5a75-f8d5-48b5-a6c3-ad67a46caebd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:34.431358 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-628c5a75-f8d5-48b5-a6c3-ad67a46caebd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:34.432878 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-628c5a75-f8d5-48b5-a6c3-ad67a46caebd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:34.433486 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-628c5a75-f8d5-48b5-a6c3-ad67a46caebd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:34.489858 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] [8251956e-4818-4fd3-9f18-d25cf21c25b2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46128. Jul 19 10:02:34.538252 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.objects.instance [None req-628c5a75-f8d5-48b5-a6c3-ad67a46caebd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lazy-loading 'services' on Instance uuid 709fd0d9-1ea3-4179-8451-39d39a0a4dff {{(pid=107464) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 10:02:34.621482 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-628c5a75-f8d5-48b5-a6c3-ad67a46caebd tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "DELETE /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/os-volume_attachments/4fe8fbcf-b45e-442e-acd6-550a894af5e6" status: 202 len: 0 microversion: 2.1 time: 0.218676 Jul 19 10:02:34.622746 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 1005/2037] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Jul 19 10:02:34 2021] DELETE /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/os-volume_attachments/4fe8fbcf-b45e-442e-acd6-550a894af5e6 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 10:02:34.625948 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [req-f2735144-3f36-427a-aaa2-5af4ccf8a069 req-ad4d1126-1d30-4319-9cb9-07befcde07c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "709fd0d9-1ea3-4179-8451-39d39a0a4dff", "tag": "0a93879d-c358-4bd1-8879-f82adb13a143"}]} {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:02:34.627951 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 10:02:34.627951 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: warnings.warn(msg) Jul 19 10:02:34.641674 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-f2735144-3f36-427a-aaa2-5af4ccf8a069 req-ad4d1126-1d30-4319-9cb9-07befcde07c0 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:34.642112 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [req-f2735144-3f36-427a-aaa2-5af4ccf8a069 req-ad4d1126-1d30-4319-9cb9-07befcde07c0 service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:34.645201 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-3b53e2a5-cae4-45a6-aac0-da82bcb1f9d5 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:34.646610 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-3b53e2a5-cae4-45a6-aac0-da82bcb1f9d5 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:02:34.658035 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3b53e2a5-cae4-45a6-aac0-da82bcb1f9d5 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:34.658487 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3b53e2a5-cae4-45a6-aac0-da82bcb1f9d5 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:34.659907 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3b53e2a5-cae4-45a6-aac0-da82bcb1f9d5 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:34.660339 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-3b53e2a5-cae4-45a6-aac0-da82bcb1f9d5 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:34.667987 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.compute.server_external_events [req-f2735144-3f36-427a-aaa2-5af4ccf8a069 req-ad4d1126-1d30-4319-9cb9-07befcde07c0 service nova] Creating event network-changed:0a93879d-c358-4bd1-8879-f82adb13a143 for instance 709fd0d9-1ea3-4179-8451-39d39a0a4dff on hv-cinder-79338 Jul 19 10:02:34.681479 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [req-f2735144-3f36-427a-aaa2-5af4ccf8a069 req-ad4d1126-1d30-4319-9cb9-07befcde07c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.275903 Jul 19 10:02:34.682653 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1033/2038] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 10:02:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:02:34.706514 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-3b53e2a5-cae4-45a6-aac0-da82bcb1f9d5 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074885 Jul 19 10:02:34.707679 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 1006/2039] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Jul 19 10:02:34 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:02:35.718087 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-e96fc467-623d-48df-8d2a-8779fa1a1d1d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:35.719186 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-e96fc467-623d-48df-8d2a-8779fa1a1d1d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:02:35.726023 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e96fc467-623d-48df-8d2a-8779fa1a1d1d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:35.726470 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e96fc467-623d-48df-8d2a-8779fa1a1d1d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:35.727257 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e96fc467-623d-48df-8d2a-8779fa1a1d1d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:35.727816 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-e96fc467-623d-48df-8d2a-8779fa1a1d1d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:35.756697 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-e96fc467-623d-48df-8d2a-8779fa1a1d1d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042601 Jul 19 10:02:35.757251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1034/2040] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Jul 19 10:02:35 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 10:02:35.766527 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-316f328b-5b60-4d8a-9c84-7eb2d9480638 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:35.767156 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-316f328b-5b60-4d8a-9c84-7eb2d9480638 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:02:35.773278 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-316f328b-5b60-4d8a-9c84-7eb2d9480638 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:35.773741 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-316f328b-5b60-4d8a-9c84-7eb2d9480638 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:35.774480 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-316f328b-5b60-4d8a-9c84-7eb2d9480638 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:35.774910 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-316f328b-5b60-4d8a-9c84-7eb2d9480638 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:35.854500 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-316f328b-5b60-4d8a-9c84-7eb2d9480638 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] HTTP exception thrown: Instance 709fd0d9-1ea3-4179-8451-39d39a0a4dff is not attached to volume 4fe8fbcf-b45e-442e-acd6-550a894af5e6 Jul 19 10:02:35.854500 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-316f328b-5b60-4d8a-9c84-7eb2d9480638 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Returning 404 to user: Instance 709fd0d9-1ea3-4179-8451-39d39a0a4dff is not attached to volume 4fe8fbcf-b45e-442e-acd6-550a894af5e6 {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 10:02:35.854737 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-316f328b-5b60-4d8a-9c84-7eb2d9480638 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "DELETE /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/os-volume_attachments/4fe8fbcf-b45e-442e-acd6-550a894af5e6" status: 404 len: 154 microversion: 2.1 time: 0.091884 Jul 19 10:02:35.855424 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 1007/2041] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Jul 19 10:02:35 2021] DELETE /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff/os-volume_attachments/4fe8fbcf-b45e-442e-acd6-550a894af5e6 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 10:02:36.986266 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-5142b663-0f41-4283-ae16-c453a770bfd8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:36.986817 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5142b663-0f41-4283-ae16-c453a770bfd8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:02:36.993694 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5142b663-0f41-4283-ae16-c453a770bfd8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:36.994147 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5142b663-0f41-4283-ae16-c453a770bfd8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:36.995111 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5142b663-0f41-4283-ae16-c453a770bfd8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:36.995547 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-5142b663-0f41-4283-ae16-c453a770bfd8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:37.020251 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-5142b663-0f41-4283-ae16-c453a770bfd8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Going to try to terminate instance {{(pid=107463) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 19 10:02:37.096008 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-5142b663-0f41-4283-ae16-c453a770bfd8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "DELETE /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 204 len: 0 microversion: 2.1 time: 0.111927 Jul 19 10:02:37.096008 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1035/2042] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Jul 19 10:02:36 2021] DELETE /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 10:02:37.105330 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-a15da576-e7a5-4999-8ff9-977e1b0349aa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:37.106002 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-a15da576-e7a5-4999-8ff9-977e1b0349aa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:02:37.113576 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a15da576-e7a5-4999-8ff9-977e1b0349aa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:37.114221 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a15da576-e7a5-4999-8ff9-977e1b0349aa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:37.115003 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a15da576-e7a5-4999-8ff9-977e1b0349aa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:37.115542 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-a15da576-e7a5-4999-8ff9-977e1b0349aa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:37.302122 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.policy [None req-a15da576-e7a5-4999-8ff9-977e1b0349aa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107464) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:02:37.310018 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-a15da576-e7a5-4999-8ff9-977e1b0349aa tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1555 microversion: 2.1 time: 0.209018 Jul 19 10:02:37.310591 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 1008/2043] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:02:37 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:02:38.326712 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-567f1250-be2b-407f-b959-a37b96a927e8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:38.327498 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-567f1250-be2b-407f-b959-a37b96a927e8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:02:38.333219 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-567f1250-be2b-407f-b959-a37b96a927e8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:38.333671 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-567f1250-be2b-407f-b959-a37b96a927e8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:38.334426 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-567f1250-be2b-407f-b959-a37b96a927e8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:38.334850 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-567f1250-be2b-407f-b959-a37b96a927e8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:38.469821 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-567f1250-be2b-407f-b959-a37b96a927e8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:02:38.477646 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-567f1250-be2b-407f-b959-a37b96a927e8 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1555 microversion: 2.1 time: 0.154748 Jul 19 10:02:38.478197 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1036/2044] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:02:38 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:02:39.318382 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [req-e9283ccf-84ac-4931-9ea8-ddd64ee5f71c req-84a78765-6e7d-41ba-b29c-1f3ab6353b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "709fd0d9-1ea3-4179-8451-39d39a0a4dff", "name": "network-vif-deleted", "tag": "0a93879d-c358-4bd1-8879-f82adb13a143"}]} {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 10:02:39.320010 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 10:02:39.320010 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: warnings.warn(msg) Jul 19 10:02:39.327087 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-e9283ccf-84ac-4931-9ea8-ddd64ee5f71c req-84a78765-6e7d-41ba-b29c-1f3ab6353b2a service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:39.327568 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [req-e9283ccf-84ac-4931-9ea8-ddd64ee5f71c req-84a78765-6e7d-41ba-b29c-1f3ab6353b2a service nova] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:39.339616 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.compute.server_external_events [req-e9283ccf-84ac-4931-9ea8-ddd64ee5f71c req-84a78765-6e7d-41ba-b29c-1f3ab6353b2a service nova] Creating event network-vif-deleted:0a93879d-c358-4bd1-8879-f82adb13a143 for instance 709fd0d9-1ea3-4179-8451-39d39a0a4dff on hv-cinder-79338 Jul 19 10:02:39.344621 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [req-e9283ccf-84ac-4931-9ea8-ddd64ee5f71c req-84a78765-6e7d-41ba-b29c-1f3ab6353b2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031068 Jul 19 10:02:39.345215 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 1009/2045] 10.222.0.16 () {64 vars in 1318 bytes} [Mon Jul 19 10:02:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 10:02:39.495398 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-c9d0b328-07bb-409f-806c-bc9aab3c5c59 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:39.496020 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.compute.api [None req-c9d0b328-07bb-409f-806c-bc9aab3c5c59 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107463) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:02:39.501928 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c9d0b328-07bb-409f-806c-bc9aab3c5c59 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:39.503016 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c9d0b328-07bb-409f-806c-bc9aab3c5c59 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:39.503813 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c9d0b328-07bb-409f-806c-bc9aab3c5c59 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:39.504285 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c9d0b328-07bb-409f-806c-bc9aab3c5c59 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:39.534109 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c9d0b328-07bb-409f-806c-bc9aab3c5c59 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:39.534492 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG oslo_concurrency.lockutils [None req-c9d0b328-07bb-409f-806c-bc9aab3c5c59 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:39.534942 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.objects.instance [None req-c9d0b328-07bb-409f-806c-bc9aab3c5c59 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lazy-loading 'fault' on Instance uuid 709fd0d9-1ea3-4179-8451-39d39a0a4dff {{(pid=107463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 19 10:02:39.577873 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.policy [None req-c9d0b328-07bb-409f-806c-bc9aab3c5c59 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce7d147f2dc42b0ad38ceb1a681c252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3116e7df5a2642949510b33d79e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107463) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 10:02:39.585922 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-c9d0b328-07bb-409f-806c-bc9aab3c5c59 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 200 len: 1349 microversion: 2.1 time: 0.094231 Jul 19 10:02:39.586602 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1037/2046] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:02:39 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 10:02:40.603326 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-aa9f9e8f-9da9-415b-a774-6e9c4aa92218 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '>' {{(pid=107464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:40.603923 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.compute.api [None req-aa9f9e8f-9da9-415b-a774-6e9c4aa92218 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] [instance: 709fd0d9-1ea3-4179-8451-39d39a0a4dff] Fetching instance by UUID {{(pid=107464) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 19 10:02:40.609963 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aa9f9e8f-9da9-415b-a774-6e9c4aa92218 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:40.610406 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aa9f9e8f-9da9-415b-a774-6e9c4aa92218 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:40.611192 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aa9f9e8f-9da9-415b-a774-6e9c4aa92218 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 19 10:02:40.611642 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG oslo_concurrency.lockutils [None req-aa9f9e8f-9da9-415b-a774-6e9c4aa92218 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Lock "15c05796-47fc-4258-ab4c-71158a7062ab" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 19 10:02:40.624877 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.wsgi [None req-aa9f9e8f-9da9-415b-a774-6e9c4aa92218 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] HTTP exception thrown: Instance 709fd0d9-1ea3-4179-8451-39d39a0a4dff could not be found. Jul 19 10:02:40.625465 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: DEBUG nova.api.openstack.wsgi [None req-aa9f9e8f-9da9-415b-a774-6e9c4aa92218 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Returning 404 to user: Instance 709fd0d9-1ea3-4179-8451-39d39a0a4dff could not be found. {{(pid=107464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 19 10:02:40.626307 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO nova.api.openstack.requestlog [None req-aa9f9e8f-9da9-415b-a774-6e9c4aa92218 tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff" status: 404 len: 111 microversion: 2.1 time: 0.027135 Jul 19 10:02:40.626829 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: [pid: 107464|app: 0|req: 1010/2047] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Jul 19 10:02:40 2021] GET /compute/v2.1/servers/709fd0d9-1ea3-4179-8451-39d39a0a4dff => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 10:02:40.635346 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: DEBUG nova.api.openstack.wsgi [None req-af0b431e-b402-4cbe-8b7c-3d3c2a71f62d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] Calling method '.version_select at 0x7f04b04065e0>' {{(pid=107463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 10:02:40.651870 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO nova.api.openstack.requestlog [None req-af0b431e-b402-4cbe-8b7c-3d3c2a71f62d tempest-TestMinimumBasicScenario-1478034569 tempest-TestMinimumBasicScenario-1478034569-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1413384313" status: 202 len: 0 microversion: 2.1 time: 0.020258 Jul 19 10:02:40.652409 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: [pid: 107463|app: 0|req: 1038/2048] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Jul 19 10:02:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1413384313 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 10:05:28.777431 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 10:05:28.778091 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 10:05:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 10:05:32.945570 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 10:05:32.946185 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 10:05:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 10:05:34.338687 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 10:05:34.339157 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 10:05:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 10:05:37.328132 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 10:05:37.328595 dv-cinder-793386-2-iscsi devstack@n-api.service[107463]: Mon Jul 19 10:05:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 10:05:46.397640 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 10:05:46.398120 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 10:05:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 10:06:55.305618 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 10:06:55.306170 dv-cinder-793386-2-iscsi devstack@n-api.service[107464]: Mon Jul 19 10:06:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!